[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:30 dist-test-slave-42z9 krb5kdc[13446](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:30 dist-test-slave-42z9 krb5kdc[13446](info): set up 2 sockets
Aug 11 01:00:30 dist-test-slave-42z9 krb5kdc[13446](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 01:00:31.522913 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.401s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:00:31 dist-test-slave-42z9 krb5kdc[13446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:00:31.654881 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:37453
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:43983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:37453
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:31.752513 13467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:31.752767 13467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:31.752802 13467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:31.754137 13467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:31.754189 13467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:31.754208 13467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:31.754225 13467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:31.754240 13467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:31.755980 13467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:43983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:37453
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:37453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:31.756320 13467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:31.756645 13467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:00:31.764120 13467 server_base.cc:1034] running on GCE node
W20260811 01:00:31.764384 13486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:31.764222 13481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:31.764222 13482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:31.764865 13467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:31.765341 13467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:31.766520 13467 hybrid_clock.cc:648] HybridClock initialized: now 1786410031766495 us; error 37 us; skew 500 ppm
Aug 11 01:00:31 dist-test-slave-42z9 krb5kdc[13446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410031, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:31.769515 13467 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:00:31.770268 13467 webserver.cc:460] Webserver started at http://127.13.30.190:43579/ using document root <none> and password file <none>
I20260811 01:00:31.770556 13467 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:31.770612 13467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:31.770746 13467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:31.772330 13467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "750548c3a16f4ff58d62ba65751f8b16"
format_stamp: "Formatted at 2026-08-11 01:00:31 on dist-test-slave-42z9"
server_key: "1c32b212a8db8a19fcd35a4782c4e9b3"
server_key_iv: "48048d1e06718722b1797b79fe81f8ae"
server_key_version: "encryptionkey@0"
I20260811 01:00:31.773133 13467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "750548c3a16f4ff58d62ba65751f8b16"
format_stamp: "Formatted at 2026-08-11 01:00:31 on dist-test-slave-42z9"
server_key: "1c32b212a8db8a19fcd35a4782c4e9b3"
server_key_iv: "48048d1e06718722b1797b79fe81f8ae"
server_key_version: "encryptionkey@0"
I20260811 01:00:31.775388 13467 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260811 01:00:31.776288 13494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:31.776535 13467 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:31.776636 13467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "750548c3a16f4ff58d62ba65751f8b16"
format_stamp: "Formatted at 2026-08-11 01:00:31 on dist-test-slave-42z9"
server_key: "1c32b212a8db8a19fcd35a4782c4e9b3"
server_key_iv: "48048d1e06718722b1797b79fe81f8ae"
server_key_version: "encryptionkey@0"
I20260811 01:00:31.776777 13467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:31.785341 13467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:31.788159 13467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:31.788372 13467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:31.797715 13467 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:37453
I20260811 01:00:31.797789 13578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:37453 every 8 connection(s)
I20260811 01:00:31.798322 13467 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:31.799782 13579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:31.801750 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 13467
I20260811 01:00:31.801887 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:31.802740 13434 external_mini_cluster.cc:1428] Setting key 3618983882f1a033d6f9706da8eec399
I20260811 01:00:31.803791 13579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16: Bootstrap starting.
I20260811 01:00:31.805058 13579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:31.805526 13579 log.cc:824] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:31.806447 13579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16: No bootstrap required, opened a new log
I20260811 01:00:31.809271 13579 raft_consensus.cc:348] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750548c3a16f4ff58d62ba65751f8b16" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37453 } }
I20260811 01:00:31.809629 13579 raft_consensus.cc:374] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:31.809736 13579 raft_consensus.cc:729] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 750548c3a16f4ff58d62ba65751f8b16, State: Initialized, Role: FOLLOWER
I20260811 01:00:31.809934 13579 consensus_queue.cc:260] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750548c3a16f4ff58d62ba65751f8b16" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37453 } }
I20260811 01:00:31.810101 13579 raft_consensus.cc:388] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:31.810137 13579 raft_consensus.cc:482] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:31.810189 13579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:31.811902 13579 raft_consensus.cc:504] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750548c3a16f4ff58d62ba65751f8b16" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37453 } }
I20260811 01:00:31.812168 13579 leader_election.cc:302] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 750548c3a16f4ff58d62ba65751f8b16; no voters:
I20260811 01:00:31.812482 13579 leader_election.cc:288] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:31.812592 13591 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:31.812779 13591 raft_consensus.cc:686] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [term 1 LEADER]: Becoming Leader. State: Replica: 750548c3a16f4ff58d62ba65751f8b16, State: Running, Role: LEADER
I20260811 01:00:31.812954 13591 consensus_queue.cc:237] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750548c3a16f4ff58d62ba65751f8b16" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37453 } }
I20260811 01:00:31.813129 13579 sys_catalog.cc:564] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:31.813407 13598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 750548c3a16f4ff58d62ba65751f8b16. Latest consensus state: current_term: 1 leader_uuid: "750548c3a16f4ff58d62ba65751f8b16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750548c3a16f4ff58d62ba65751f8b16" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37453 } } }
I20260811 01:00:31.813535 13598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:31.813413 13596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "750548c3a16f4ff58d62ba65751f8b16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750548c3a16f4ff58d62ba65751f8b16" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37453 } } }
I20260811 01:00:31.813819 13596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:31.814781 13601 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:31.815480 13601 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:31.818090 13601 catalog_manager.cc:1347] Generated new cluster ID: 1720bf0313c94a0fa3ddbea35100fdbe
I20260811 01:00:31.818166 13601 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 01:00:31 dist-test-slave-42z9 krb5kdc[13446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:31.824033 13584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:31.804217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48408 (local address 127.13.30.190:37453)
0811 01:00:31.804556 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:31.804570 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:31.804982 (+ 412us) server_negotiation.cc:407] Connection header received
0811 01:00:31.808362 (+ 3380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:31.808377 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:31.808551 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:31.808736 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:31.810828 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:31.812903 (+ 2075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:31.814984 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:31.815675 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:31.815857 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:31.820149 (+ 4292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:31.820154 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:31.820155 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:31.820168 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:31.821979 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:31.822466 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:31.822469 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:31.822470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:31.822567 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:31.822826 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:31.822827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:31.822827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:31.823095 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:31.823255 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:31.823558 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 01:00:31.823757 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":119,"threads_started":1}
I20260811 01:00:31.842222 13601 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:31.842895 13601 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:31.846508 13601 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 750548c3a16f4ff58d62ba65751f8b16: Generated new TSK 0
I20260811 01:00:31.846710 13601 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:00:31.886591 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37453
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:43983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:31.996332 13623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:31.996582 13623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:31.996611 13623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:31.998050 13623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:31.998119 13623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:31.998152 13623 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:00:31.999903 13623 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:43983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37453
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:32.000281 13623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:32.000591 13623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:32.008803 13636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:32.008803 13633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:32.008862 13634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:32.009382 13623 server_base.cc:1034] running on GCE node
I20260811 01:00:32.009666 13623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:32.009940 13623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:32.011116 13623 hybrid_clock.cc:648] HybridClock initialized: now 1786410032011099 us; error 31 us; skew 500 ppm
Aug 11 01:00:32 dist-test-slave-42z9 krb5kdc[13446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410032, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:32.014397 13623 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:00:32.015085 13623 webserver.cc:460] Webserver started at http://127.13.30.129:36525/ using document root <none> and password file <none>
I20260811 01:00:32.015362 13623 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:32.015420 13623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:32.015570 13623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:32.016793 13623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "b059256f87a24838980e639280d34506"
format_stamp: "Formatted at 2026-08-11 01:00:32 on dist-test-slave-42z9"
server_key: "d6286c064f22d88fee858ccda0cf899f"
server_key_iv: "50d972f6d63d0a3865b216833ece591a"
server_key_version: "encryptionkey@0"
I20260811 01:00:32.017300 13623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "b059256f87a24838980e639280d34506"
format_stamp: "Formatted at 2026-08-11 01:00:32 on dist-test-slave-42z9"
server_key: "d6286c064f22d88fee858ccda0cf899f"
server_key_iv: "50d972f6d63d0a3865b216833ece591a"
server_key_version: "encryptionkey@0"
I20260811 01:00:32.019479 13623 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260811 01:00:32.021080 13656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:32.021358 13623 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 01:00:32.021528 13623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "b059256f87a24838980e639280d34506"
format_stamp: "Formatted at 2026-08-11 01:00:32 on dist-test-slave-42z9"
server_key: "d6286c064f22d88fee858ccda0cf899f"
server_key_iv: "50d972f6d63d0a3865b216833ece591a"
server_key_version: "encryptionkey@0"
I20260811 01:00:32.021626 13623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:32.046830 13623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:32.049188 13623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:32.049350 13623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:32.049721 13623 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:32.050159 13623 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:32.050210 13623 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:32.050243 13623 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:32.050261 13623 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:32.064396 13623 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:42425
I20260811 01:00:32.064477 13848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:42425 every 8 connection(s)
I20260811 01:00:32.064916 13623 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
Aug 11 01:00:32 dist-test-slave-42z9 krb5kdc[13446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410032, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:32.074793 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 13623
I20260811 01:00:32.074918 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:00:32.075150 13434 external_mini_cluster.cc:1428] Setting key fc02462c6508f2a5c4afa6e78ae5a3b5
I20260811 01:00:32.076140 13584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:32.065829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:46193 (local address 127.13.30.190:37453)
0811 01:00:32.065932 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:32.065934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:32.066183 (+ 249us) server_negotiation.cc:407] Connection header received
0811 01:00:32.066650 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:32.066651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:32.066663 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:32.066726 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:32.067881 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.068396 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.069480 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.069722 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.069784 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:32.072533 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:32.072534 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:32.072535 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:32.072543 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:32.073941 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:32.074695 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:32.074696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:32.074696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:32.074772 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:32.075182 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:32.075183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:32.075184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:32.075352 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:32.075426 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:32.075908 (+ 482us) server_negotiation.cc:299] Negotiation successful
0811 01:00:32.076053 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 01:00:32.076439 13852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:32.065777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37453 (local address 127.13.30.129:46193)
0811 01:00:32.066012 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:32.066059 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:32.066565 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:32.066793 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:32.066797 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:32.067563 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:32.067782 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:32.067788 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.068488 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.068489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:32.069362 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:32.069366 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.069797 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.069798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:32.069914 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:32.070448 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:32.070458 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:32.072392 (+ 1934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:32.074111 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:32.074129 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:32.074132 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:32.074565 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:32.074850 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:32.074851 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:32.074852 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:32.075046 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:32.075445 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:32.075462 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:32.075686 (+ 224us) client_negotiation.cc:769] Sending connection context
0811 01:00:32.075834 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 01:00:32.076068 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":125,"threads_started":1}
I20260811 01:00:32.077112 13850 heartbeater.cc:347] Connected to a master server at 127.13.30.190:37453
I20260811 01:00:32.077227 13850 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:32.077495 13850 heartbeater.cc:511] Master 127.13.30.190:37453 requested a full tablet report, sending...
I20260811 01:00:32.078382 13518 ts_manager.cc:194] Registered new tserver with Master: b059256f87a24838980e639280d34506 (127.13.30.129:42425)
I20260811 01:00:32.079293 13518 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:46193
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:00:32.105017 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37453
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:43983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:32.198289 13856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:32.198558 13856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:32.198586 13856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:32.199966 13856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:32.200029 13856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:32.200062 13856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:00:32.201977 13856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:43983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37453
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:32.202283 13856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:32.202541 13856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:32.208280 13865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:32.208280 13862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:32.208428 13856 server_base.cc:1034] running on GCE node
W20260811 01:00:32.208380 13870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:32.208699 13856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:32.208995 13856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:32.210146 13856 hybrid_clock.cc:648] HybridClock initialized: now 1786410032210132 us; error 32 us; skew 500 ppm
Aug 11 01:00:32 dist-test-slave-42z9 krb5kdc[13446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410032, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:32.212925 13856 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:00:32.213696 13856 webserver.cc:460] Webserver started at http://127.13.30.130:44419/ using document root <none> and password file <none>
I20260811 01:00:32.213967 13856 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:32.214020 13856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:32.214160 13856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:32.215425 13856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "1762b764f6164e4090c6edc546295603"
format_stamp: "Formatted at 2026-08-11 01:00:32 on dist-test-slave-42z9"
server_key: "89f15c70d07343acc44b21c11c8982f2"
server_key_iv: "c91049c997629cf4922e981bb6db719f"
server_key_version: "encryptionkey@0"
I20260811 01:00:32.215909 13856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "1762b764f6164e4090c6edc546295603"
format_stamp: "Formatted at 2026-08-11 01:00:32 on dist-test-slave-42z9"
server_key: "89f15c70d07343acc44b21c11c8982f2"
server_key_iv: "c91049c997629cf4922e981bb6db719f"
server_key_version: "encryptionkey@0"
I20260811 01:00:32.217828 13856 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 01:00:32.218741 13885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:32.218914 13856 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:32.219003 13856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "1762b764f6164e4090c6edc546295603"
format_stamp: "Formatted at 2026-08-11 01:00:32 on dist-test-slave-42z9"
server_key: "89f15c70d07343acc44b21c11c8982f2"
server_key_iv: "c91049c997629cf4922e981bb6db719f"
server_key_version: "encryptionkey@0"
I20260811 01:00:32.219069 13856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:32.247716 13856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:32.250128 13856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:32.250288 13856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:32.250715 13856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:32.251166 13856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:32.251207 13856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:32.251237 13856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:32.251262 13856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:32.262537 13856 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:34629
I20260811 01:00:32.262576 14080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:34629 every 8 connection(s)
I20260811 01:00:32.262956 13856 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
Aug 11 01:00:32 dist-test-slave-42z9 krb5kdc[13446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410032, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:32.271986 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 13856
I20260811 01:00:32.272092 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:00:32.272286 13434 external_mini_cluster.cc:1428] Setting key a3db765afa596986ee610beb36a3a8d8
I20260811 01:00:32.272905 13584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:32.263831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:39133 (local address 127.13.30.190:37453)
0811 01:00:32.263899 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:32.263901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:32.264106 (+ 205us) server_negotiation.cc:407] Connection header received
0811 01:00:32.264647 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:32.264648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:32.264659 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:32.264711 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:32.265844 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.266638 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.267674 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.267868 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.267920 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:32.270184 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:32.270186 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:32.270186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:32.270194 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:32.271517 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:32.271919 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:32.271919 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:32.271920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:32.271969 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:32.272243 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:32.272244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:32.272244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:32.272403 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:32.272461 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:32.272720 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 01:00:32.272812 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 01:00:32.273089 14084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:32.263788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37453 (local address 127.13.30.130:39133)
0811 01:00:32.263991 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:32.264031 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:32.264561 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:32.264769 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:32.264773 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:32.265415 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:32.265739 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:32.265747 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.266733 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.266734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:32.267596 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:32.267599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.267930 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.267931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:32.268042 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:32.268546 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:32.268554 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:32.270083 (+ 1529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:32.271588 (+ 1505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:32.271593 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:32.271595 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:32.271852 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:32.272026 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:32.272027 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:32.272027 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:32.272186 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:32.272455 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:32.272463 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:32.272607 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 01:00:32.272699 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 01:00:32.272852 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":116,"threads_started":1}
I20260811 01:00:32.273818 14082 heartbeater.cc:347] Connected to a master server at 127.13.30.190:37453
I20260811 01:00:32.273933 14082 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:32.274132 14082 heartbeater.cc:511] Master 127.13.30.190:37453 requested a full tablet report, sending...
I20260811 01:00:32.274516 13518 ts_manager.cc:194] Registered new tserver with Master: 1762b764f6164e4090c6edc546295603 (127.13.30.130:34629)
I20260811 01:00:32.274905 13518 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:39133
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:00:32.300267 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37453
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:43983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:32.395309 14100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:32.395565 14100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:32.395593 14100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:32.396865 14100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:32.396912 14100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:32.396941 14100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:00:32.398582 14100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:43983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37453
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:32.398845 14100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:32.399065 14100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:32.404682 14110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:32.404685 14111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:32.404698 14113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:32.405057 14100 server_base.cc:1034] running on GCE node
I20260811 01:00:32.405277 14100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:32.405547 14100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:32.406690 14100 hybrid_clock.cc:648] HybridClock initialized: now 1786410032406680 us; error 29 us; skew 500 ppm
Aug 11 01:00:32 dist-test-slave-42z9 krb5kdc[13446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410032, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:32.409555 14100 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:00:32.410147 14100 webserver.cc:460] Webserver started at http://127.13.30.131:38431/ using document root <none> and password file <none>
I20260811 01:00:32.410393 14100 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:32.410447 14100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:32.410590 14100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:32.411792 14100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "6af9586d3cb1426ca4a0fb80bc00e908"
format_stamp: "Formatted at 2026-08-11 01:00:32 on dist-test-slave-42z9"
server_key: "537c0cb39b6f40aad6864f155f5201db"
server_key_iv: "adfa1d2a379ba2abf4a52642804127aa"
server_key_version: "encryptionkey@0"
I20260811 01:00:32.412287 14100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "6af9586d3cb1426ca4a0fb80bc00e908"
format_stamp: "Formatted at 2026-08-11 01:00:32 on dist-test-slave-42z9"
server_key: "537c0cb39b6f40aad6864f155f5201db"
server_key_iv: "adfa1d2a379ba2abf4a52642804127aa"
server_key_version: "encryptionkey@0"
I20260811 01:00:32.414217 14100 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260811 01:00:32.415133 14121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:32.415333 14100 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:32.415437 14100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "6af9586d3cb1426ca4a0fb80bc00e908"
format_stamp: "Formatted at 2026-08-11 01:00:32 on dist-test-slave-42z9"
server_key: "537c0cb39b6f40aad6864f155f5201db"
server_key_iv: "adfa1d2a379ba2abf4a52642804127aa"
server_key_version: "encryptionkey@0"
I20260811 01:00:32.415522 14100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:32.427474 14100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:32.429793 14100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:32.429927 14100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:32.430171 14100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:32.430584 14100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:32.430621 14100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:32.430645 14100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:32.430665 14100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:32.441977 14100 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:36285
I20260811 01:00:32.442032 14299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:36285 every 8 connection(s)
I20260811 01:00:32.442408 14100 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:00:32.447206 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 14100
I20260811 01:00:32.447311 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:00:32.447467 13434 external_mini_cluster.cc:1428] Setting key 79562699b1456a80fcac653f75782bf1
Aug 11 01:00:32 dist-test-slave-42z9 krb5kdc[13446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410032, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:32.452380 13584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:32.443377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:38419 (local address 127.13.30.190:37453)
0811 01:00:32.443441 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:32.443444 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:32.443738 (+ 294us) server_negotiation.cc:407] Connection header received
0811 01:00:32.444271 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:32.444272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:32.444286 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:32.444339 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:32.445322 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.445969 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.447051 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.447256 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.447315 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:32.449876 (+ 2561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:32.449878 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:32.449878 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:32.449885 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:32.451071 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:32.451483 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:32.451485 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:32.451485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:32.451547 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:32.451760 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:32.451761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:32.451761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:32.451882 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:32.451937 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:32.452210 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 01:00:32.452292 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 01:00:32.452486 14303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:32.443374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37453 (local address 127.13.30.131:38419)
0811 01:00:32.443574 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:32.443614 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:32.444171 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:32.444408 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:32.444412 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:32.445014 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:32.445223 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:32.445228 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.446071 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.446073 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:32.446955 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:32.446958 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.447333 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.447334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:32.447468 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:32.448078 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:32.448089 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:32.449794 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:32.451145 (+ 1351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:32.451152 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:32.451154 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:32.451394 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:32.451605 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:32.451605 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:32.451606 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:32.451699 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:32.451933 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:32.451937 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:32.452061 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 01:00:32.452144 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 01:00:32.452280 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":132,"threads_started":1}
I20260811 01:00:32.452934 14301 heartbeater.cc:347] Connected to a master server at 127.13.30.190:37453
I20260811 01:00:32.453032 14301 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:32.453197 14301 heartbeater.cc:511] Master 127.13.30.190:37453 requested a full tablet report, sending...
I20260811 01:00:32.453577 13518 ts_manager.cc:194] Registered new tserver with Master: 6af9586d3cb1426ca4a0fb80bc00e908 (127.13.30.131:36285)
I20260811 01:00:32.453969 13518 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:38419
I20260811 01:00:32.460168 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:00:32 dist-test-slave-42z9 krb5kdc[13446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410032, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:00:32 dist-test-slave-42z9 krb5kdc[13446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410032, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.30.129@KRBTEST.COM
I20260811 01:00:32.490777 14312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:32.481491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58208 (local address 127.13.30.129:42425)
0811 01:00:32.481833 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:32.481839 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:32.481853 (+ 14us) server_negotiation.cc:407] Connection header received
0811 01:00:32.481893 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:32.481895 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:32.481911 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:32.481992 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:32.483038 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.483788 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.484613 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.485295 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.485369 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:32.487988 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:32.488000 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:32.488001 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:32.488009 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:32.489686 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:32.490046 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:32.490049 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:32.490049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:32.490114 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:32.490259 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:32.490260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:32.490260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:32.490421 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:32.490546 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:32.490589 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 01:00:32.490662 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":221,"threads_started":1}
W20260811 01:00:32.491396 13713 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58208
Aug 11 01:00:32 dist-test-slave-42z9 krb5kdc[13446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:00:32 dist-test-slave-42z9 krb5kdc[13446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.129@KRBTEST.COM
I20260811 01:00:32.516860 14312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:32.509856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58216 (local address 127.13.30.129:42425)
0811 01:00:32.509917 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:32.509919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:32.509976 (+ 57us) server_negotiation.cc:407] Connection header received
0811 01:00:32.510069 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:32.510070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:32.510085 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:32.510132 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:32.510719 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.511240 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.511973 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:32.512184 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:32.512242 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:32.514626 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:32.514628 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:32.514628 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:32.514637 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:32.515798 (+ 1161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:32.516111 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:32.516112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:32.516112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:32.516164 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:32.516324 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:32.516325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:32.516325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:32.516429 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:32.516628 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:32.516666 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 01:00:32.516753 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 01:00:32.517396 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 13623
I20260811 01:00:32.532786 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 13856
I20260811 01:00:32.549254 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 14100
I20260811 01:00:32.559757 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 13467
2026-08-11T01:00:32Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2475 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:32 dist-test-slave-42z9 krb5kdc[14327](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:32 dist-test-slave-42z9 krb5kdc[14327](info): set up 2 sockets
Aug 11 01:00:32 dist-test-slave-42z9 krb5kdc[14327](info): commencing operation
krb5kdc: starting...
W20260811 01:00:33.746577 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:00:33 dist-test-slave-42z9 krb5kdc[14327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:00:33.873241 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:34259
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:35911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:34259
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:33.959888 14346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:33.960134 14346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:33.960168 14346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:33.961473 14346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:33.961531 14346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:33.961551 14346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:33.961568 14346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:33.961591 14346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:33.963219 14346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:35911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:34259
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:34259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:33.963506 14346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:33.963743 14346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:33.968778 14355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:33.968772 14356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:33.968775 14359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:33.969095 14346 server_base.cc:1034] running on GCE node
I20260811 01:00:33.969653 14346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:33.969990 14346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:33.971139 14346 hybrid_clock.cc:648] HybridClock initialized: now 1786410033971119 us; error 39 us; skew 500 ppm
Aug 11 01:00:33 dist-test-slave-42z9 krb5kdc[14327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410033, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:33.973788 14346 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:00:33.974360 14346 webserver.cc:460] Webserver started at http://127.13.30.190:39401/ using document root <none> and password file <none>
I20260811 01:00:33.974593 14346 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:33.974642 14346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:33.974776 14346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:33.975894 14346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "95472e4071d64caf872d3dc661e80a61"
format_stamp: "Formatted at 2026-08-11 01:00:33 on dist-test-slave-42z9"
server_key: "614f2f962e3b719d8defc8ed4b6d989c"
server_key_iv: "b56ee8747d2c29367faf34e87fc92566"
server_key_version: "encryptionkey@0"
I20260811 01:00:33.976243 14346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "95472e4071d64caf872d3dc661e80a61"
format_stamp: "Formatted at 2026-08-11 01:00:33 on dist-test-slave-42z9"
server_key: "614f2f962e3b719d8defc8ed4b6d989c"
server_key_iv: "b56ee8747d2c29367faf34e87fc92566"
server_key_version: "encryptionkey@0"
I20260811 01:00:33.977641 14346 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:33.978386 14368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:33.978531 14346 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:33.978617 14346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "95472e4071d64caf872d3dc661e80a61"
format_stamp: "Formatted at 2026-08-11 01:00:33 on dist-test-slave-42z9"
server_key: "614f2f962e3b719d8defc8ed4b6d989c"
server_key_iv: "b56ee8747d2c29367faf34e87fc92566"
server_key_version: "encryptionkey@0"
I20260811 01:00:33.978689 14346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:33.987430 14346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:33.989557 14346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:33.989706 14346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:33.994324 14346 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:34259
I20260811 01:00:33.994370 14455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:34259 every 8 connection(s)
I20260811 01:00:33.994753 14346 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:33.995728 14456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:33.998469 14456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61: Bootstrap starting.
I20260811 01:00:33.999128 14456 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:33.999258 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 14346
I20260811 01:00:33.999361 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:33.999490 14456 log.cc:824] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:33.999513 13434 external_mini_cluster.cc:1428] Setting key 4b6505bc04115bb7a7c5e2c76147b2b6
I20260811 01:00:34.000591 14456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61: No bootstrap required, opened a new log
I20260811 01:00:34.003522 14456 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95472e4071d64caf872d3dc661e80a61" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34259 } }
I20260811 01:00:34.003706 14456 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:34.003729 14456 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95472e4071d64caf872d3dc661e80a61, State: Initialized, Role: FOLLOWER
I20260811 01:00:34.003883 14456 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95472e4071d64caf872d3dc661e80a61" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34259 } }
I20260811 01:00:34.003965 14456 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:34.003999 14456 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:34.004050 14456 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:34.004822 14456 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95472e4071d64caf872d3dc661e80a61" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34259 } }
I20260811 01:00:34.004951 14456 leader_election.cc:302] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95472e4071d64caf872d3dc661e80a61; no voters:
I20260811 01:00:34.005156 14456 leader_election.cc:288] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:34.005204 14466 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:34.005414 14466 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [term 1 LEADER]: Becoming Leader. State: Replica: 95472e4071d64caf872d3dc661e80a61, State: Running, Role: LEADER
I20260811 01:00:34.005487 14456 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:34.005610 14466 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95472e4071d64caf872d3dc661e80a61" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34259 } }
I20260811 01:00:34.006003 14467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95472e4071d64caf872d3dc661e80a61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95472e4071d64caf872d3dc661e80a61" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34259 } } }
I20260811 01:00:34.005988 14469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95472e4071d64caf872d3dc661e80a61. Latest consensus state: current_term: 1 leader_uuid: "95472e4071d64caf872d3dc661e80a61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95472e4071d64caf872d3dc661e80a61" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34259 } } }
I20260811 01:00:34.006096 14467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:34.006098 14469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:34.006428 14473 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:34.007434 14473 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[14327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:34.009248 14473 catalog_manager.cc:1347] Generated new cluster ID: abd091678f0b468e81487cc131060fbb
I20260811 01:00:34.009310 14473 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:34.012612 14463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.000077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34392 (local address 127.13.30.190:34259)
0811 01:00:34.000258 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:34.000268 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:34.000302 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:00:34.000962 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:34.000973 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:34.001043 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:34.001201 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:34.001857 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.003318 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.004530 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.005192 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.005708 (+ 516us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.008415 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:34.008420 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:34.008421 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:34.008434 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:34.010743 (+ 2309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.011239 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.011244 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.011244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.011360 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.011597 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.011598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.011598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.011957 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:34.012134 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:34.012216 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 01:00:34.012375 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":76,"threads_started":1}
I20260811 01:00:34.036453 14473 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:34.037060 14473 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:34.045104 14473 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95472e4071d64caf872d3dc661e80a61: Generated new TSK 0
I20260811 01:00:34.045341 14473 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:00:34.078817 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34259
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:35911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:34.195423 14497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:34.195667 14497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:34.195694 14497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:34.196993 14497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:34.197058 14497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:34.197089 14497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:00:34.198813 14497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:35911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34259
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:34.199100 14497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:34.199368 14497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:34.204867 14502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:34.204866 14507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:34.204859 14503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:34.205049 14497 server_base.cc:1034] running on GCE node
I20260811 01:00:34.205868 14497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:34.206183 14497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:34.207337 14497 hybrid_clock.cc:648] HybridClock initialized: now 1786410034207321 us; error 33 us; skew 500 ppm
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[14327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410034, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:34.210173 14497 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:00:34.210688 14497 webserver.cc:460] Webserver started at http://127.13.30.129:40025/ using document root <none> and password file <none>
I20260811 01:00:34.210913 14497 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:34.210963 14497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:34.211105 14497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:34.212230 14497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "b9ee784eee9e4d2c854f6357843d1233"
format_stamp: "Formatted at 2026-08-11 01:00:34 on dist-test-slave-42z9"
server_key: "dd7a2de9112a6702e455621b941834ed"
server_key_iv: "e3a3d92d4f933a22044b82608fc15053"
server_key_version: "encryptionkey@0"
I20260811 01:00:34.212589 14497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "b9ee784eee9e4d2c854f6357843d1233"
format_stamp: "Formatted at 2026-08-11 01:00:34 on dist-test-slave-42z9"
server_key: "dd7a2de9112a6702e455621b941834ed"
server_key_iv: "e3a3d92d4f933a22044b82608fc15053"
server_key_version: "encryptionkey@0"
I20260811 01:00:34.214128 14497 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:34.214860 14518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:34.215031 14497 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:34.215130 14497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "b9ee784eee9e4d2c854f6357843d1233"
format_stamp: "Formatted at 2026-08-11 01:00:34 on dist-test-slave-42z9"
server_key: "dd7a2de9112a6702e455621b941834ed"
server_key_iv: "e3a3d92d4f933a22044b82608fc15053"
server_key_version: "encryptionkey@0"
I20260811 01:00:34.215201 14497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:34.229804 14497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:34.231933 14497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:34.232100 14497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:34.232353 14497 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:34.232695 14497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:34.232731 14497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:34.232764 14497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:34.232796 14497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:34.239178 14497 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:37411
I20260811 01:00:34.239223 14702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:37411 every 8 connection(s)
I20260811 01:00:34.239605 14497 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[14327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410034, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:34.246304 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 14497
I20260811 01:00:34.246390 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:00:34.246552 13434 external_mini_cluster.cc:1428] Setting key f75007c33b004d28ce7f4831be321ec7
I20260811 01:00:34.250078 14463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.240391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:55627 (local address 127.13.30.190:34259)
0811 01:00:34.240442 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:34.240445 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:34.240672 (+ 227us) server_negotiation.cc:407] Connection header received
0811 01:00:34.241810 (+ 1138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:34.241812 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:34.241823 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:34.241888 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:34.242566 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.243097 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.244076 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.244269 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.244317 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.246969 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:34.246972 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:34.246972 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:34.246985 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:34.248440 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.249004 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.249006 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.249006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.249078 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.249325 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.249327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.249327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.249511 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:34.249576 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:34.249867 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 01:00:34.249978 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 01:00:34.250284 14705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.240381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:34259 (local address 127.13.30.129:55627)
0811 01:00:34.240540 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:34.240584 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:34.241670 (+ 1086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:34.241949 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:34.241953 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:34.242235 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:34.242450 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.242456 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.243175 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.243175 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.244003 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.244005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.244339 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.244340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.244452 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.244959 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:34.244967 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:34.246786 (+ 1819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:34.248589 (+ 1803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:34.248605 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:34.248608 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:34.248917 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:34.249139 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:34.249140 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:34.249140 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:34.249266 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:34.249567 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:34.249575 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:34.249737 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 01:00:34.249837 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 01:00:34.250038 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
I20260811 01:00:34.250864 14703 heartbeater.cc:347] Connected to a master server at 127.13.30.190:34259
I20260811 01:00:34.250988 14703 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:34.251204 14703 heartbeater.cc:511] Master 127.13.30.190:34259 requested a full tablet report, sending...
I20260811 01:00:34.251820 14394 ts_manager.cc:194] Registered new tserver with Master: b9ee784eee9e4d2c854f6357843d1233 (127.13.30.129:37411)
I20260811 01:00:34.252456 14394 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:55627
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:00:34.274544 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34259
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:35911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:34.361907 14712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:34.362136 14712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:34.362165 14712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:34.363454 14712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:34.363513 14712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:34.363544 14712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:00:34.365589 14712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:35911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34259
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:34.365867 14712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:34.366103 14712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:34.371600 14724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:34.371649 14726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:34.371658 14723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:34.371750 14712 server_base.cc:1034] running on GCE node
I20260811 01:00:34.372042 14712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:34.372313 14712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:34.373498 14712 hybrid_clock.cc:648] HybridClock initialized: now 1786410034373480 us; error 33 us; skew 500 ppm
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[14327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410034, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:34.376075 14712 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:00:34.376616 14712 webserver.cc:460] Webserver started at http://127.13.30.130:38201/ using document root <none> and password file <none>
I20260811 01:00:34.376850 14712 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:34.376900 14712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:34.377039 14712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:34.378208 14712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "cca3862258bc435e9e564fd2e5c9efe9"
format_stamp: "Formatted at 2026-08-11 01:00:34 on dist-test-slave-42z9"
server_key: "b0dd0c6fa940cc39cf4274d0316326a2"
server_key_iv: "c79cbe09659ba07dbfc64706b5f77905"
server_key_version: "encryptionkey@0"
I20260811 01:00:34.378578 14712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "cca3862258bc435e9e564fd2e5c9efe9"
format_stamp: "Formatted at 2026-08-11 01:00:34 on dist-test-slave-42z9"
server_key: "b0dd0c6fa940cc39cf4274d0316326a2"
server_key_iv: "c79cbe09659ba07dbfc64706b5f77905"
server_key_version: "encryptionkey@0"
I20260811 01:00:34.379981 14712 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:00:34.380841 14737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:34.381028 14712 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:34.381129 14712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "cca3862258bc435e9e564fd2e5c9efe9"
format_stamp: "Formatted at 2026-08-11 01:00:34 on dist-test-slave-42z9"
server_key: "b0dd0c6fa940cc39cf4274d0316326a2"
server_key_iv: "c79cbe09659ba07dbfc64706b5f77905"
server_key_version: "encryptionkey@0"
I20260811 01:00:34.381201 14712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:34.414932 14712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:34.417126 14712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:34.417277 14712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:34.417549 14712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:34.417891 14712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:34.417943 14712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:34.417999 14712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:34.418021 14712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:34.424021 14712 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:37783
I20260811 01:00:34.424072 14925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:37783 every 8 connection(s)
I20260811 01:00:34.424415 14712 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[14327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410034, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:34.431739 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 14712
I20260811 01:00:34.431836 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:00:34.432026 13434 external_mini_cluster.cc:1428] Setting key 9af72645836ae613e5685efa1b490c88
I20260811 01:00:34.434047 14463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.425172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:39393 (local address 127.13.30.190:34259)
0811 01:00:34.425240 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:34.425242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:34.425507 (+ 265us) server_negotiation.cc:407] Connection header received
0811 01:00:34.426557 (+ 1050us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:34.426559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:34.426570 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:34.426636 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:34.427346 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.427852 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.428844 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.429042 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.429093 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.431316 (+ 2223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:34.431318 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:34.431318 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:34.431326 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:34.432685 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.433091 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.433092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.433092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.433158 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.433362 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.433363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.433363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.433541 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:34.433604 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:34.433860 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 01:00:34.433954 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 01:00:34.434166 14929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.425131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:34259 (local address 127.13.30.130:39393)
0811 01:00:34.425341 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:34.425388 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:34.426379 (+ 991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:34.426711 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:34.426715 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:34.427023 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:34.427233 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.427237 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.427945 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.427946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.428780 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.428783 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.429105 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.429106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.429208 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.429780 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:34.429789 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:34.431215 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:34.432761 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:34.432771 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:34.432774 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:34.433021 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:34.433217 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:34.433217 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:34.433217 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:34.433314 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:34.433606 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:34.433610 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:34.433740 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 01:00:34.433824 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 01:00:34.433968 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":97,"threads_started":1}
I20260811 01:00:34.434661 14926 heartbeater.cc:347] Connected to a master server at 127.13.30.190:34259
I20260811 01:00:34.434762 14926 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:34.434947 14926 heartbeater.cc:511] Master 127.13.30.190:34259 requested a full tablet report, sending...
I20260811 01:00:34.435319 14394 ts_manager.cc:194] Registered new tserver with Master: cca3862258bc435e9e564fd2e5c9efe9 (127.13.30.130:37783)
I20260811 01:00:34.435699 14394 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:39393
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:00:34.458009 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34259
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:35911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:34.545249 14937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:34.545526 14937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:34.545558 14937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:34.546917 14937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:34.546976 14937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:34.547008 14937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:00:34.548673 14937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:35911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34259
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14937
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:34.548923 14937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:34.549129 14937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:34.554464 14945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:34.554508 14937 server_base.cc:1034] running on GCE node
W20260811 01:00:34.554469 14948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:34.554458 14951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:34.554883 14937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:34.555167 14937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:34.556355 14937 hybrid_clock.cc:648] HybridClock initialized: now 1786410034556334 us; error 37 us; skew 500 ppm
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[14327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410034, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:34.559003 14937 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:00:34.559515 14937 webserver.cc:460] Webserver started at http://127.13.30.131:36211/ using document root <none> and password file <none>
I20260811 01:00:34.559744 14937 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:34.559798 14937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:34.559937 14937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:34.561079 14937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "39096088666a4bcdb2e59dd555a43633"
format_stamp: "Formatted at 2026-08-11 01:00:34 on dist-test-slave-42z9"
server_key: "d7fe19311886d416458add2b360a0329"
server_key_iv: "ffed1976b2fbb7f295831058c0f1a90d"
server_key_version: "encryptionkey@0"
I20260811 01:00:34.561488 14937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "39096088666a4bcdb2e59dd555a43633"
format_stamp: "Formatted at 2026-08-11 01:00:34 on dist-test-slave-42z9"
server_key: "d7fe19311886d416458add2b360a0329"
server_key_iv: "ffed1976b2fbb7f295831058c0f1a90d"
server_key_version: "encryptionkey@0"
I20260811 01:00:34.563130 14937 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:34.564018 14960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:34.564172 14937 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:34.564263 14937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "39096088666a4bcdb2e59dd555a43633"
format_stamp: "Formatted at 2026-08-11 01:00:34 on dist-test-slave-42z9"
server_key: "d7fe19311886d416458add2b360a0329"
server_key_iv: "ffed1976b2fbb7f295831058c0f1a90d"
server_key_version: "encryptionkey@0"
I20260811 01:00:34.564353 14937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:34.583166 14937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:34.585399 14937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:34.585633 14937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:34.585875 14937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:34.586220 14937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:34.586266 14937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:34.586297 14937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:34.586315 14937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:34.592736 14937 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:40331
I20260811 01:00:34.592784 15137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:40331 every 8 connection(s)
I20260811 01:00:34.593174 14937 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:00:34.594199 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 14937
I20260811 01:00:34.594277 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:00:34.594434 13434 external_mini_cluster.cc:1428] Setting key fdd4331b32acfe3c6fa0f7011c202903
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[14327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410034, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:34.603082 14463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.593983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:40785 (local address 127.13.30.190:34259)
0811 01:00:34.594048 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:34.594051 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:34.594294 (+ 243us) server_negotiation.cc:407] Connection header received
0811 01:00:34.595542 (+ 1248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:34.595543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:34.595553 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:34.595602 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:34.596244 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.596763 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.597866 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.598071 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.598124 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.600451 (+ 2327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:34.600453 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:34.600453 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:34.600473 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:34.601900 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.602306 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.602307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.602308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.602358 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.602552 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.602553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.602553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.602665 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:34.602713 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:34.602939 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 01:00:34.603009 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 01:00:34.603292 15140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.593969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:34259 (local address 127.13.30.131:40785)
0811 01:00:34.594151 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:34.594198 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:34.595423 (+ 1225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:34.595664 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:34.595668 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:34.595966 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:34.596176 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.596181 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.596868 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.596869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.597778 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.597780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.598135 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.598136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.598241 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.598815 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:34.598824 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:34.600361 (+ 1537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:34.601988 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:34.601997 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:34.601999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:34.602245 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:34.602402 (+ 157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:34.602403 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:34.602403 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:34.602506 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:34.602709 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:34.602712 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:34.602841 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 01:00:34.602923 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 01:00:34.603058 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":76,"threads_started":1}
I20260811 01:00:34.603839 15138 heartbeater.cc:347] Connected to a master server at 127.13.30.190:34259
I20260811 01:00:34.603938 15138 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:34.604113 15138 heartbeater.cc:511] Master 127.13.30.190:34259 requested a full tablet report, sending...
I20260811 01:00:34.604655 14394 ts_manager.cc:194] Registered new tserver with Master: 39096088666a4bcdb2e59dd555a43633 (127.13.30.131:40331)
I20260811 01:00:34.605022 14394 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:40785
I20260811 01:00:34.606185 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:00:34.613955 14463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.608147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34398 (local address 127.13.30.190:34259)
0811 01:00:34.608276 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:34.608278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:34.608360 (+ 82us) server_negotiation.cc:407] Connection header received
0811 01:00:34.608427 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:34.608428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:34.608438 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:34.608501 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:34.609049 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.609601 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.610294 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.610504 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.610560 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.611699 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:34.611700 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:34.611701 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:34.611708 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:34.612819 (+ 1111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.613133 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.613134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.613135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.613193 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.613350 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.613350 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.613351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.613564 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:34.613658 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:34.613776 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 01:00:34.613861 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 01:00:34.616465 14394 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34398:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:00:34.618481 14394 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:00:34.626132 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.622210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38042 (local address 127.13.30.131:40331)
0811 01:00:34.622508 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:34.622513 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:34.622525 (+ 12us) server_negotiation.cc:407] Connection header received
0811 01:00:34.622575 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:34.622577 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:34.622594 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:34.622666 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:34.622896 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.623984 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.625043 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.625704 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.625770 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.625837 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:34.625994 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 01:00:34.626042 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":92,"threads_started":1}
I20260811 01:00:34.626155 15157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.621815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:40331 (local address 127.0.0.1:38042)
0811 01:00:34.622013 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:34.622055 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:34.622127 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:34.622769 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:34.622770 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:34.622773 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:34.622815 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.622816 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.624087 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.624088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.624954 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.624957 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.625789 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.625790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.625889 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.625901 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 01:00:34.625966 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 01:00:34.626032 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":1,"thread_start_us":80,"threads_started":1}
I20260811 01:00:34.626335 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.622033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59304 (local address 127.13.30.130:37783)
0811 01:00:34.622204 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:34.622209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:34.622220 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:00:34.622308 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:34.622311 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:34.622329 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:34.622412 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:34.622817 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.623552 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.624999 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.625740 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.625810 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.625868 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:34.626199 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 01:00:34.626252 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":85,"threads_started":1}
I20260811 01:00:34.626329 15162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.621816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:37411 (local address 127.0.0.1:45966)
0811 01:00:34.622014 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:34.622201 (+ 187us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:34.622233 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:34.622633 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:34.622634 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:34.622637 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:34.622698 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.622700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.624053 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.624054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.625195 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.625198 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.626144 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.626144 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.626204 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.626208 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:00:34.626234 (+ 26us) client_negotiation.cc:240] Negotiation successful
0811 01:00:34.626268 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":33,"thread_start_us":104,"threads_started":1}
I20260811 01:00:34.626494 15163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.621816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:37783 (local address 127.0.0.1:59304)
0811 01:00:34.622066 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:34.622074 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:34.622127 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:34.622603 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:34.622607 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:34.622610 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:34.622693 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.622696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.623700 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.623701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.624904 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.624907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.625907 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.625909 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.625975 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.625979 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:00:34.626031 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 01:00:34.626083 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":22,"thread_start_us":96,"threads_started":1}
I20260811 01:00:34.626693 15166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.622284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45966 (local address 127.13.30.129:37411)
0811 01:00:34.622466 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:34.622471 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:34.622481 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:00:34.622520 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:34.622522 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:34.622536 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:34.622771 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:34.622842 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.623938 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.625279 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.626057 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.626464 (+ 407us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.626534 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:34.626564 (+ 30us) server_negotiation.cc:299] Negotiation successful
0811 01:00:34.626614 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":93,"threads_started":1}
I20260811 01:00:34.627405 14598 tablet_service.cc:1467] Processing CreateTablet for tablet 81e37cd4b59b45daab26d61fe5fb8666 (DEFAULT_TABLE table=test-table [id=4e2dd9a263f845ecbe223282cd4c7c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:34.627408 14811 tablet_service.cc:1467] Processing CreateTablet for tablet 81e37cd4b59b45daab26d61fe5fb8666 (DEFAULT_TABLE table=test-table [id=4e2dd9a263f845ecbe223282cd4c7c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:34.627761 14811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81e37cd4b59b45daab26d61fe5fb8666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:34.627760 14598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81e37cd4b59b45daab26d61fe5fb8666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:34.630012 15036 tablet_service.cc:1467] Processing CreateTablet for tablet 81e37cd4b59b45daab26d61fe5fb8666 (DEFAULT_TABLE table=test-table [id=4e2dd9a263f845ecbe223282cd4c7c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:34.630419 15036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81e37cd4b59b45daab26d61fe5fb8666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:34.631057 15168 tablet_bootstrap.cc:492] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233: Bootstrap starting.
I20260811 01:00:34.631335 15169 tablet_bootstrap.cc:492] T 81e37cd4b59b45daab26d61fe5fb8666 P cca3862258bc435e9e564fd2e5c9efe9: Bootstrap starting.
I20260811 01:00:34.631819 15168 tablet_bootstrap.cc:654] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:34.632316 15169 tablet_bootstrap.cc:654] T 81e37cd4b59b45daab26d61fe5fb8666 P cca3862258bc435e9e564fd2e5c9efe9: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:34.632686 15168 log.cc:824] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:34.632980 15169 log.cc:824] T 81e37cd4b59b45daab26d61fe5fb8666 P cca3862258bc435e9e564fd2e5c9efe9: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:34.633527 15178 tablet_bootstrap.cc:492] T 81e37cd4b59b45daab26d61fe5fb8666 P 39096088666a4bcdb2e59dd555a43633: Bootstrap starting.
I20260811 01:00:34.633651 15168 tablet_bootstrap.cc:492] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233: No bootstrap required, opened a new log
I20260811 01:00:34.633720 15168 ts_tablet_manager.cc:1397] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 01:00:34.634491 15178 tablet_bootstrap.cc:654] T 81e37cd4b59b45daab26d61fe5fb8666 P 39096088666a4bcdb2e59dd555a43633: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:34.635031 15178 log.cc:824] T 81e37cd4b59b45daab26d61fe5fb8666 P 39096088666a4bcdb2e59dd555a43633: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:34.635771 15178 tablet_bootstrap.cc:492] T 81e37cd4b59b45daab26d61fe5fb8666 P 39096088666a4bcdb2e59dd555a43633: No bootstrap required, opened a new log
I20260811 01:00:34.635675 15168 raft_consensus.cc:348] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cca3862258bc435e9e564fd2e5c9efe9" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37783 } } peers { permanent_uuid: "b9ee784eee9e4d2c854f6357843d1233" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 37411 } } peers { permanent_uuid: "39096088666a4bcdb2e59dd555a43633" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40331 } }
I20260811 01:00:34.635828 15178 ts_tablet_manager.cc:1397] T 81e37cd4b59b45daab26d61fe5fb8666 P 39096088666a4bcdb2e59dd555a43633: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:00:34.635818 15168 raft_consensus.cc:374] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:34.635854 15168 raft_consensus.cc:729] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9ee784eee9e4d2c854f6357843d1233, State: Initialized, Role: FOLLOWER
I20260811 01:00:34.635977 15168 consensus_queue.cc:260] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cca3862258bc435e9e564fd2e5c9efe9" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37783 } } peers { permanent_uuid: "b9ee784eee9e4d2c854f6357843d1233" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 37411 } } peers { permanent_uuid: "39096088666a4bcdb2e59dd555a43633" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40331 } }
I20260811 01:00:34.636314 15168 ts_tablet_manager.cc:1428] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:00:34.636377 14703 heartbeater.cc:503] Master 127.13.30.190:34259 was elected leader, sending a full tablet report...
I20260811 01:00:34.636751 15169 tablet_bootstrap.cc:492] T 81e37cd4b59b45daab26d61fe5fb8666 P cca3862258bc435e9e564fd2e5c9efe9: No bootstrap required, opened a new log
I20260811 01:00:34.636828 15169 ts_tablet_manager.cc:1397] T 81e37cd4b59b45daab26d61fe5fb8666 P cca3862258bc435e9e564fd2e5c9efe9: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260811 01:00:34.637988 15178 raft_consensus.cc:348] T 81e37cd4b59b45daab26d61fe5fb8666 P 39096088666a4bcdb2e59dd555a43633 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cca3862258bc435e9e564fd2e5c9efe9" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37783 } } peers { permanent_uuid: "b9ee784eee9e4d2c854f6357843d1233" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 37411 } } peers { permanent_uuid: "39096088666a4bcdb2e59dd555a43633" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40331 } }
I20260811 01:00:34.638170 15178 raft_consensus.cc:374] T 81e37cd4b59b45daab26d61fe5fb8666 P 39096088666a4bcdb2e59dd555a43633 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:34.638212 15178 raft_consensus.cc:729] T 81e37cd4b59b45daab26d61fe5fb8666 P 39096088666a4bcdb2e59dd555a43633 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39096088666a4bcdb2e59dd555a43633, State: Initialized, Role: FOLLOWER
I20260811 01:00:34.638336 15178 consensus_queue.cc:260] T 81e37cd4b59b45daab26d61fe5fb8666 P 39096088666a4bcdb2e59dd555a43633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cca3862258bc435e9e564fd2e5c9efe9" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37783 } } peers { permanent_uuid: "b9ee784eee9e4d2c854f6357843d1233" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 37411 } } peers { permanent_uuid: "39096088666a4bcdb2e59dd555a43633" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40331 } }
I20260811 01:00:34.638645 15138 heartbeater.cc:503] Master 127.13.30.190:34259 was elected leader, sending a full tablet report...
I20260811 01:00:34.638643 15178 ts_tablet_manager.cc:1428] T 81e37cd4b59b45daab26d61fe5fb8666 P 39096088666a4bcdb2e59dd555a43633: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 01:00:34.638940 15169 raft_consensus.cc:348] T 81e37cd4b59b45daab26d61fe5fb8666 P cca3862258bc435e9e564fd2e5c9efe9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cca3862258bc435e9e564fd2e5c9efe9" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37783 } } peers { permanent_uuid: "b9ee784eee9e4d2c854f6357843d1233" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 37411 } } peers { permanent_uuid: "39096088666a4bcdb2e59dd555a43633" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40331 } }
I20260811 01:00:34.639130 15169 raft_consensus.cc:374] T 81e37cd4b59b45daab26d61fe5fb8666 P cca3862258bc435e9e564fd2e5c9efe9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:34.639174 15169 raft_consensus.cc:729] T 81e37cd4b59b45daab26d61fe5fb8666 P cca3862258bc435e9e564fd2e5c9efe9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca3862258bc435e9e564fd2e5c9efe9, State: Initialized, Role: FOLLOWER
I20260811 01:00:34.639312 15169 consensus_queue.cc:260] T 81e37cd4b59b45daab26d61fe5fb8666 P cca3862258bc435e9e564fd2e5c9efe9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cca3862258bc435e9e564fd2e5c9efe9" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37783 } } peers { permanent_uuid: "b9ee784eee9e4d2c854f6357843d1233" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 37411 } } peers { permanent_uuid: "39096088666a4bcdb2e59dd555a43633" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40331 } }
I20260811 01:00:34.639597 15169 ts_tablet_manager.cc:1428] T 81e37cd4b59b45daab26d61fe5fb8666 P cca3862258bc435e9e564fd2e5c9efe9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:00:34.639665 14926 heartbeater.cc:503] Master 127.13.30.190:34259 was elected leader, sending a full tablet report...
W20260811 01:00:34.675027 14928 tablet.cc:2369] T 81e37cd4b59b45daab26d61fe5fb8666 P cca3862258bc435e9e564fd2e5c9efe9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:00:34.732586 15182 raft_consensus.cc:482] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:00:34.732765 15182 raft_consensus.cc:504] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cca3862258bc435e9e564fd2e5c9efe9" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37783 } } peers { permanent_uuid: "b9ee784eee9e4d2c854f6357843d1233" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 37411 } } peers { permanent_uuid: "39096088666a4bcdb2e59dd555a43633" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40331 } }
I20260811 01:00:34.733520 15182 leader_election.cc:288] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cca3862258bc435e9e564fd2e5c9efe9 (127.13.30.130:37783), 39096088666a4bcdb2e59dd555a43633 (127.13.30.131:40331)
I20260811 01:00:34.736896 14705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.733692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:40331 (local address 127.13.30.129:49231)
0811 01:00:34.733761 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:34.733774 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:34.733841 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:34.734184 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:34.734185 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:34.734187 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:34.734312 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.734315 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.735251 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.735252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.736033 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.736035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.736646 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.736647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.736723 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.736727 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:00:34.736770 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 01:00:34.736810 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 01:00:34.736917 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.733947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:49231 (local address 127.13.30.131:40331)
0811 01:00:34.734003 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:34.734005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:34.734013 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:00:34.734059 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:34.734060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:34.734070 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:34.734126 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:34.734394 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.735163 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.736141 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.736560 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.736621 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.736630 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:34.736797 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 01:00:34.736846 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 01:00:34.736963 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.733875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:55351 (local address 127.13.30.130:37783)
0811 01:00:34.733925 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:34.733927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:34.734005 (+ 78us) server_negotiation.cc:407] Connection header received
0811 01:00:34.734121 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:34.734122 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:34.734132 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:34.734212 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:34.734419 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.735163 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.736175 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.736596 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.736675 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.736685 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:34.736847 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 01:00:34.736901 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 01:00:34.737196 15186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.733735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:37783 (local address 127.13.30.129:55351)
0811 01:00:34.733913 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:34.733923 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:34.734040 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:34.734225 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:34.734226 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:34.734228 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:34.734308 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.734310 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.735289 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.735290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.736071 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:34.736073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.736690 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.736691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:34.736772 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.736777 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:00:34.736831 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 01:00:34.736879 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":19,"thread_start_us":97,"threads_started":1}
I20260811 01:00:34.737404 15071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81e37cd4b59b45daab26d61fe5fb8666" candidate_uuid: "b9ee784eee9e4d2c854f6357843d1233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39096088666a4bcdb2e59dd555a43633" is_pre_election: true
I20260811 01:00:34.737581 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81e37cd4b59b45daab26d61fe5fb8666" candidate_uuid: "b9ee784eee9e4d2c854f6357843d1233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca3862258bc435e9e564fd2e5c9efe9" is_pre_election: true
I20260811 01:00:34.737661 15071 raft_consensus.cc:2454] T 81e37cd4b59b45daab26d61fe5fb8666 P 39096088666a4bcdb2e59dd555a43633 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9ee784eee9e4d2c854f6357843d1233 in term 0.
I20260811 01:00:34.737735 14852 raft_consensus.cc:2454] T 81e37cd4b59b45daab26d61fe5fb8666 P cca3862258bc435e9e564fd2e5c9efe9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9ee784eee9e4d2c854f6357843d1233 in term 0.
I20260811 01:00:34.737964 14520 leader_election.cc:302] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9ee784eee9e4d2c854f6357843d1233, cca3862258bc435e9e564fd2e5c9efe9; no voters:
I20260811 01:00:34.738102 15182 raft_consensus.cc:2781] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:00:34.738165 15182 raft_consensus.cc:482] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:00:34.738188 15182 raft_consensus.cc:3037] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:34.739034 15182 raft_consensus.cc:504] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cca3862258bc435e9e564fd2e5c9efe9" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37783 } } peers { permanent_uuid: "b9ee784eee9e4d2c854f6357843d1233" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 37411 } } peers { permanent_uuid: "39096088666a4bcdb2e59dd555a43633" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40331 } }
I20260811 01:00:34.739169 15182 leader_election.cc:288] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [CANDIDATE]: Term 1 election: Requested vote from peers cca3862258bc435e9e564fd2e5c9efe9 (127.13.30.130:37783), 39096088666a4bcdb2e59dd555a43633 (127.13.30.131:40331)
I20260811 01:00:34.739352 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81e37cd4b59b45daab26d61fe5fb8666" candidate_uuid: "b9ee784eee9e4d2c854f6357843d1233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca3862258bc435e9e564fd2e5c9efe9"
I20260811 01:00:34.739352 15071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81e37cd4b59b45daab26d61fe5fb8666" candidate_uuid: "b9ee784eee9e4d2c854f6357843d1233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39096088666a4bcdb2e59dd555a43633"
I20260811 01:00:34.739435 15071 raft_consensus.cc:3037] T 81e37cd4b59b45daab26d61fe5fb8666 P 39096088666a4bcdb2e59dd555a43633 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:34.739437 14852 raft_consensus.cc:3037] T 81e37cd4b59b45daab26d61fe5fb8666 P cca3862258bc435e9e564fd2e5c9efe9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:34.740278 14852 raft_consensus.cc:2454] T 81e37cd4b59b45daab26d61fe5fb8666 P cca3862258bc435e9e564fd2e5c9efe9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9ee784eee9e4d2c854f6357843d1233 in term 1.
I20260811 01:00:34.740314 15071 raft_consensus.cc:2454] T 81e37cd4b59b45daab26d61fe5fb8666 P 39096088666a4bcdb2e59dd555a43633 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9ee784eee9e4d2c854f6357843d1233 in term 1.
W20260811 01:00:34.740360 14704 tablet.cc:2369] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:00:34.740494 14520 leader_election.cc:302] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9ee784eee9e4d2c854f6357843d1233, cca3862258bc435e9e564fd2e5c9efe9; no voters:
I20260811 01:00:34.740602 15182 raft_consensus.cc:2781] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:34.740746 15182 raft_consensus.cc:686] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [term 1 LEADER]: Becoming Leader. State: Replica: b9ee784eee9e4d2c854f6357843d1233, State: Running, Role: LEADER
I20260811 01:00:34.740836 15182 consensus_queue.cc:237] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cca3862258bc435e9e564fd2e5c9efe9" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37783 } } peers { permanent_uuid: "b9ee784eee9e4d2c854f6357843d1233" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 37411 } } peers { permanent_uuid: "39096088666a4bcdb2e59dd555a43633" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40331 } }
I20260811 01:00:34.741876 14392 catalog_manager.cc:5495] T 81e37cd4b59b45daab26d61fe5fb8666 P b9ee784eee9e4d2c854f6357843d1233 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9ee784eee9e4d2c854f6357843d1233 (127.13.30.129). New cstate: current_term: 1 leader_uuid: "b9ee784eee9e4d2c854f6357843d1233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cca3862258bc435e9e564fd2e5c9efe9" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9ee784eee9e4d2c854f6357843d1233" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 37411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39096088666a4bcdb2e59dd555a43633" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40331 } health_report { overall_health: UNKNOWN } } }
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[14327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.129@KRBTEST.COM
I20260811 01:00:34.779222 15166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.771533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45978 (local address 127.13.30.129:37411)
0811 01:00:34.771608 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:34.771610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:34.771672 (+ 62us) server_negotiation.cc:407] Connection header received
0811 01:00:34.771742 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:34.771743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:34.771752 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:34.771792 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:34.772451 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.772934 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.773806 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.774012 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.774081 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.776511 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:34.776522 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:34.776522 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:34.776529 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:34.778219 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.778567 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.778570 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.778570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.778629 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.778765 (+ 136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.778765 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.778765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.778904 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:34.779025 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:34.779059 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 01:00:34.779132 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[14327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410034, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[14327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410034, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.30.129@KRBTEST.COM
I20260811 01:00:34.806456 15166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.799509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45982 (local address 127.13.30.129:37411)
0811 01:00:34.799589 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:34.799592 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:34.799660 (+ 68us) server_negotiation.cc:407] Connection header received
0811 01:00:34.799716 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:34.799717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:34.799726 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:34.799778 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:34.800319 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.800871 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.801647 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.801848 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.801906 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.804058 (+ 2152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:34.804060 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:34.804060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:34.804068 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:34.805365 (+ 1297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.805737 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.805738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.805738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.805791 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.805945 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.805945 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.805946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.806064 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:34.806145 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:34.806296 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 01:00:34.806369 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[14327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[14327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.129@KRBTEST.COM
I20260811 01:00:34.836733 15166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:34.829845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45992 (local address 127.13.30.129:37411)
0811 01:00:34.829909 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:34.829911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:34.830100 (+ 189us) server_negotiation.cc:407] Connection header received
0811 01:00:34.830171 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:34.830172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:34.830182 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:34.830222 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:34.830820 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.831318 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.832061 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:34.832242 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:34.832291 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:34.834550 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:34.834552 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:34.834552 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:34.834560 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:34.835836 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.836143 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.836144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.836144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.836194 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:34.836324 (+ 130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:34.836324 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:34.836325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:34.836426 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:34.836499 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:34.836580 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 01:00:34.836647 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260811 01:00:34.837682 14567 tablet_service.cc:2908] Rejecting scan request for tablet 81e37cd4b59b45daab26d61fe5fb8666: Uninitialized: clean time has not yet been initialized
I20260811 01:00:34.838652 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 14497
W20260811 01:00:34.845577 15139 tablet.cc:2369] T 81e37cd4b59b45daab26d61fe5fb8666 P 39096088666a4bcdb2e59dd555a43633: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:00:34.851877 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 14712
I20260811 01:00:34.883564 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 14937
I20260811 01:00:34.897825 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 14346
2026-08-11T01:00:34Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2350 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[15212](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[15212](info): set up 2 sockets
Aug 11 01:00:34 dist-test-slave-42z9 krb5kdc[15212](info): commencing operation
krb5kdc: starting...
W20260811 01:00:36.087581 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:00:36 dist-test-slave-42z9 krb5kdc[15212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:00:36.212661 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:42381
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:41939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:42381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:36.297861 15231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:36.298101 15231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:36.298136 15231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:36.299422 15231 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:36.299481 15231 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 01:00:36.299499 15231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:36.299515 15231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:36.299531 15231 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:36.299547 15231 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:36.301229 15231 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:41939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:42381
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:42381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:36.301551 15231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:36.301797 15231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:36.307061 15239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:36.307070 15237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:36.307119 15241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:36.307089 15231 server_base.cc:1034] running on GCE node
I20260811 01:00:36.307503 15231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:36.307808 15231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:36.308975 15231 hybrid_clock.cc:648] HybridClock initialized: now 1786410036308962 us; error 40 us; skew 500 ppm
Aug 11 01:00:36 dist-test-slave-42z9 krb5kdc[15212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410036, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:36.311529 15231 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:00:36.312091 15231 webserver.cc:460] Webserver started at http://127.13.30.190:34891/ using document root <none> and password file <none>
I20260811 01:00:36.312314 15231 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:36.312357 15231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:36.312462 15231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:36.313571 15231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "8be853676e9546d3a7ddd2fba1281d99"
format_stamp: "Formatted at 2026-08-11 01:00:36 on dist-test-slave-42z9"
server_key: "4feebdaf216330cd76a01e685afa3ad7"
server_key_iv: "4cc3dd2bc8736a3cfb28ee30d9a42d04"
server_key_version: "encryptionkey@0"
I20260811 01:00:36.313894 15231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "8be853676e9546d3a7ddd2fba1281d99"
format_stamp: "Formatted at 2026-08-11 01:00:36 on dist-test-slave-42z9"
server_key: "4feebdaf216330cd76a01e685afa3ad7"
server_key_iv: "4cc3dd2bc8736a3cfb28ee30d9a42d04"
server_key_version: "encryptionkey@0"
I20260811 01:00:36.315164 15231 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:36.315928 15252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:36.316120 15231 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:36.316210 15231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "8be853676e9546d3a7ddd2fba1281d99"
format_stamp: "Formatted at 2026-08-11 01:00:36 on dist-test-slave-42z9"
server_key: "4feebdaf216330cd76a01e685afa3ad7"
server_key_iv: "4cc3dd2bc8736a3cfb28ee30d9a42d04"
server_key_version: "encryptionkey@0"
I20260811 01:00:36.316278 15231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:36.336269 15231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:36.338855 15231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:36.339020 15231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:36.344236 15231 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:42381
I20260811 01:00:36.344301 15356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:42381 every 8 connection(s)
I20260811 01:00:36.344663 15231 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:36.345351 15357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:36.347884 15357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99: Bootstrap starting.
I20260811 01:00:36.348505 15357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:36.348763 15357 log.cc:824] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:36.348951 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 15231
I20260811 01:00:36.349051 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:36.349210 13434 external_mini_cluster.cc:1428] Setting key 65c497850b491ae75c8a344270d010fd
I20260811 01:00:36.349740 15357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99: No bootstrap required, opened a new log
I20260811 01:00:36.352262 15357 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8be853676e9546d3a7ddd2fba1281d99" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42381 } }
I20260811 01:00:36.352429 15357 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:36.352456 15357 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8be853676e9546d3a7ddd2fba1281d99, State: Initialized, Role: FOLLOWER
I20260811 01:00:36.352593 15357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8be853676e9546d3a7ddd2fba1281d99" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42381 } }
I20260811 01:00:36.352679 15357 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:36.352713 15357 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:36.352762 15357 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:36.353596 15357 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8be853676e9546d3a7ddd2fba1281d99" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42381 } }
I20260811 01:00:36.353708 15357 leader_election.cc:302] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8be853676e9546d3a7ddd2fba1281d99; no voters:
I20260811 01:00:36.353892 15357 leader_election.cc:288] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:36.353955 15364 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:36.354177 15364 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [term 1 LEADER]: Becoming Leader. State: Replica: 8be853676e9546d3a7ddd2fba1281d99, State: Running, Role: LEADER
I20260811 01:00:36.354185 15357 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:36.354357 15364 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8be853676e9546d3a7ddd2fba1281d99" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42381 } }
I20260811 01:00:36.356065 15365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8be853676e9546d3a7ddd2fba1281d99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8be853676e9546d3a7ddd2fba1281d99" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42381 } } }
I20260811 01:00:36.356173 15365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [sys.catalog]: This master's current role is: LEADER
W20260811 01:00:36.356344 15395 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:00:36.356443 15395 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:00:36.356453 15366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8be853676e9546d3a7ddd2fba1281d99. Latest consensus state: current_term: 1 leader_uuid: "8be853676e9546d3a7ddd2fba1281d99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8be853676e9546d3a7ddd2fba1281d99" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42381 } } }
I20260811 01:00:36.356593 15366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:36.356716 15398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:36.356912 15398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:36.358566 15398 catalog_manager.cc:1347] Generated new cluster ID: 247940d6686148c6bd2574b520ab0d0c
I20260811 01:00:36.358619 15398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 01:00:36 dist-test-slave-42z9 krb5kdc[15212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:36.368690 15361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.349765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44790 (local address 127.13.30.190:42381)
0811 01:00:36.349942 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:36.349951 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:36.349981 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:00:36.352255 (+ 2274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:36.352266 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:36.352334 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:36.352504 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:36.353298 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.354637 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.355625 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.356203 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.356311 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.364318 (+ 8007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:36.364324 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:36.364325 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:36.364341 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:36.366392 (+ 2051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.366833 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.366837 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.366837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.366951 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.367123 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.367124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.367124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.367429 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:36.367604 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:36.368045 (+ 441us) server_negotiation.cc:299] Negotiation successful
0811 01:00:36.368198 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":90,"threads_started":1}
I20260811 01:00:36.390873 15398 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:36.391789 15398 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:36.394802 15398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99: Generated new TSK 0
I20260811 01:00:36.395047 15398 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:00:36.424285 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42381
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:41939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:36.516676 15402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:36.516929 15402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:36.516966 15402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:36.518334 15402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:36.518393 15402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:36.518424 15402 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:00:36.518450 15402 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:00:36.520251 15402 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:41939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.30.190:42381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:36.520538 15402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:36.520787 15402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:36.526065 15410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:36.526096 15416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:36.526120 15411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:36.526319 15402 server_base.cc:1034] running on GCE node
I20260811 01:00:36.526533 15402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:36.526778 15402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:36.527935 15402 hybrid_clock.cc:648] HybridClock initialized: now 1786410036527917 us; error 31 us; skew 500 ppm
Aug 11 01:00:36 dist-test-slave-42z9 krb5kdc[15212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410036, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:36.530669 15402 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:00:36.531260 15402 webserver.cc:460] Webserver started at http://127.13.30.129:45969/ using document root <none> and password file <none>
I20260811 01:00:36.531493 15402 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:36.531538 15402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:36.531642 15402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:36.532819 15402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "6a2695c03ef84db5af9498e77d7e83ef"
format_stamp: "Formatted at 2026-08-11 01:00:36 on dist-test-slave-42z9"
server_key: "27df2cde9e55e7d86ee8cc0d7024c2f9"
server_key_iv: "acc5afc0a9e61d949744ef85c47d66eb"
server_key_version: "encryptionkey@0"
I20260811 01:00:36.533140 15402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "6a2695c03ef84db5af9498e77d7e83ef"
format_stamp: "Formatted at 2026-08-11 01:00:36 on dist-test-slave-42z9"
server_key: "27df2cde9e55e7d86ee8cc0d7024c2f9"
server_key_iv: "acc5afc0a9e61d949744ef85c47d66eb"
server_key_version: "encryptionkey@0"
I20260811 01:00:36.534538 15402 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:00:36.535259 15427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:36.535463 15402 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:36.535552 15402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "6a2695c03ef84db5af9498e77d7e83ef"
format_stamp: "Formatted at 2026-08-11 01:00:36 on dist-test-slave-42z9"
server_key: "27df2cde9e55e7d86ee8cc0d7024c2f9"
server_key_iv: "acc5afc0a9e61d949744ef85c47d66eb"
server_key_version: "encryptionkey@0"
I20260811 01:00:36.535619 15402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:36.544346 15402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:36.546466 15402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:36.546598 15402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:36.547142 15402 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:36.547183 15402 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:36.547210 15402 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:36.547226 15402 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:36.554389 15402 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:40607
I20260811 01:00:36.554724 15617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:40607 every 8 connection(s)
I20260811 01:00:36.554960 15402 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
Aug 11 01:00:36 dist-test-slave-42z9 krb5kdc[15212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410036, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:36.559129 15361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.547728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:42119 (local address 127.13.30.190:42381)
0811 01:00:36.547780 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:36.547782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:36.548035 (+ 253us) server_negotiation.cc:407] Connection header received
0811 01:00:36.548603 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:36.548605 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:36.548625 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:36.548690 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:36.549628 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.550425 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.551982 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.552297 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.552391 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.556231 (+ 3840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:36.556233 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:36.556234 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:36.556243 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:36.557696 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.558144 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.558146 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.558146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.558207 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.558442 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.558443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.558443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.558571 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:36.558631 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:36.558928 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 01:00:36.559034 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 01:00:36.559322 15437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.547738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42381 (local address 127.13.30.129:42119)
0811 01:00:36.547916 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:36.547953 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:36.548474 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:36.548778 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:36.548782 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:36.549152 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:36.549522 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.549529 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.550545 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.550547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.551880 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.551885 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.552398 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.552398 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.552522 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.553575 (+ 1053us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:36.553625 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:36.556114 (+ 2489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:36.557787 (+ 1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:36.557797 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:36.557808 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:36.558068 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:36.558265 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:36.558266 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:36.558266 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:36.558384 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:36.558630 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:36.558638 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:36.558790 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 01:00:36.558894 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 01:00:36.559076 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":97,"threads_started":1}
I20260811 01:00:36.559831 15619 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42381
I20260811 01:00:36.559938 15619 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:36.560161 15619 heartbeater.cc:511] Master 127.13.30.190:42381 requested a full tablet report, sending...
I20260811 01:00:36.560783 15275 ts_manager.cc:194] Registered new tserver with Master: 6a2695c03ef84db5af9498e77d7e83ef (127.13.30.129:40607)
I20260811 01:00:36.560936 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 15402
I20260811 01:00:36.561030 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:00:36.561264 13434 external_mini_cluster.cc:1428] Setting key 0df506f4b47fcdf244c2e6275a0ee8d3
I20260811 01:00:36.561720 15275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:42119
I20260811 01:00:36.567346 15361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.561080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:60045 (local address 127.13.30.190:42381)
0811 01:00:36.561473 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:36.561474 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:36.561483 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:00:36.561504 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:36.561505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:36.561516 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:36.561575 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:36.562200 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.562856 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.563546 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.563823 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.563888 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.564840 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:36.564842 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:36.564842 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:36.564849 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:36.566307 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.566623 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.566625 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.566625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.566684 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.566847 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.566848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.566848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.566960 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:36.567016 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:36.567155 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 01:00:36.567242 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338}
I20260811 01:00:36.567368 15636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.561084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42381 (local address 127.13.30.129:60045)
0811 01:00:36.561224 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:36.561235 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:36.561283 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:36.561795 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:36.561796 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:36.562019 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:36.562094 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.562097 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.562961 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.562962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.563461 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.563462 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.563899 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.563900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.563980 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.564425 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:36.564430 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:36.564748 (+ 318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:36.566393 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:36.566394 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:36.566395 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:36.566563 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:36.566736 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:36.566737 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:36.566737 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:36.566797 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:36.567013 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:36.567014 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:36.567066 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 01:00:36.567126 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 01:00:36.567241 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":76,"threads_started":1}
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:00:36.587914 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42381
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:41939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:36.675175 15639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:36.675431 15639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:36.675459 15639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:36.676721 15639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:36.676770 15639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:36.676791 15639 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:00:36.676810 15639 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:00:36.678407 15639 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:41939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.30.190:42381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:36.678651 15639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:36.678879 15639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:36.684442 15650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:36.684437 15647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:36.684448 15646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:36.684708 15639 server_base.cc:1034] running on GCE node
I20260811 01:00:36.684950 15639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:36.685205 15639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:36.686399 15639 hybrid_clock.cc:648] HybridClock initialized: now 1786410036686374 us; error 33 us; skew 500 ppm
Aug 11 01:00:36 dist-test-slave-42z9 krb5kdc[15212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410036, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:36.689100 15639 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:00:36.689669 15639 webserver.cc:460] Webserver started at http://127.13.30.130:42297/ using document root <none> and password file <none>
I20260811 01:00:36.689924 15639 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:36.689980 15639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:36.690117 15639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:36.691231 15639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "76420d0098b24b0d8cebfc124f43e9ad"
format_stamp: "Formatted at 2026-08-11 01:00:36 on dist-test-slave-42z9"
server_key: "b9af797562e45f30ffb2d2d3c003dbc3"
server_key_iv: "e5512a38528842b15cf9761662c58db6"
server_key_version: "encryptionkey@0"
I20260811 01:00:36.691617 15639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "76420d0098b24b0d8cebfc124f43e9ad"
format_stamp: "Formatted at 2026-08-11 01:00:36 on dist-test-slave-42z9"
server_key: "b9af797562e45f30ffb2d2d3c003dbc3"
server_key_iv: "e5512a38528842b15cf9761662c58db6"
server_key_version: "encryptionkey@0"
I20260811 01:00:36.692991 15639 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:00:36.693768 15660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:36.693919 15639 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:36.694015 15639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "76420d0098b24b0d8cebfc124f43e9ad"
format_stamp: "Formatted at 2026-08-11 01:00:36 on dist-test-slave-42z9"
server_key: "b9af797562e45f30ffb2d2d3c003dbc3"
server_key_iv: "e5512a38528842b15cf9761662c58db6"
server_key_version: "encryptionkey@0"
I20260811 01:00:36.694092 15639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:36.707264 15639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:36.709246 15639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:36.709398 15639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:36.710129 15639 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:36.710175 15639 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:36.710206 15639 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:36.710229 15639 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:00:36 dist-test-slave-42z9 krb5kdc[15212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410036, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:36.717779 15639 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:46255
I20260811 01:00:36.717831 15853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:46255 every 8 connection(s)
I20260811 01:00:36.718310 15639 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:00:36.720489 15361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.710523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:37017 (local address 127.13.30.190:42381)
0811 01:00:36.710586 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:36.710588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:36.710889 (+ 301us) server_negotiation.cc:407] Connection header received
0811 01:00:36.711402 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:36.711404 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:36.711417 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:36.711494 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:36.712193 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.712925 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.714169 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.714378 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.714438 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.717115 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:36.717117 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:36.717117 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:36.717126 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:36.718805 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.719279 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.719291 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.719292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.719360 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.719906 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.719907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.719908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.720043 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:36.720108 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:36.720345 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 01:00:36.720421 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 01:00:36.720669 15678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.710519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42381 (local address 127.13.30.130:37017)
0811 01:00:36.710752 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:36.710798 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:36.711305 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:36.711570 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:36.711574 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:36.711872 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:36.712094 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.712099 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.713018 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.713019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.714077 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.714082 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.714459 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.714461 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.714600 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.715148 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:36.715160 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:36.717002 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:36.718895 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:36.718901 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:36.718903 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:36.719179 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:36.719527 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:36.719529 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:36.719529 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:36.719799 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:36.720108 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:36.720112 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:36.720237 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 01:00:36.720320 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 01:00:36.720460 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":144,"threads_started":1}
I20260811 01:00:36.721143 15855 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42381
I20260811 01:00:36.721236 15855 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:36.721477 15855 heartbeater.cc:511] Master 127.13.30.190:42381 requested a full tablet report, sending...
I20260811 01:00:36.721899 15277 ts_manager.cc:194] Registered new tserver with Master: 76420d0098b24b0d8cebfc124f43e9ad (127.13.30.130:46255)
I20260811 01:00:36.722430 15277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:37017
I20260811 01:00:36.724113 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 15639
I20260811 01:00:36.724200 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:00:36.724370 13434 external_mini_cluster.cc:1428] Setting key 9385535f48ce751ad598f8f9ea29f1e9
I20260811 01:00:36.728111 15361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.722310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:43493 (local address 127.13.30.190:42381)
0811 01:00:36.722357 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:36.722359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:36.722469 (+ 110us) server_negotiation.cc:407] Connection header received
0811 01:00:36.722561 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:36.722562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:36.722572 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:36.722600 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:36.723039 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.723522 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.724204 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.724460 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.724523 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.725689 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:36.725690 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:36.725691 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:36.725698 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:36.726968 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.727376 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.727377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.727377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.727447 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.727637 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.727638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.727638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.727784 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:36.727833 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:36.727980 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 01:00:36.728045 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 01:00:36.728154 15865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.722226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42381 (local address 127.13.30.130:43493)
0811 01:00:36.722404 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:36.722415 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:36.722496 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:36.722659 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:36.722660 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:36.722884 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:36.722958 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.722961 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.723610 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.723611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.724119 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.724121 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.724624 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.724626 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.724697 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.725185 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:36.725191 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:36.725601 (+ 410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:36.727051 (+ 1450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:36.727052 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:36.727053 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:36.727273 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:36.727519 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:36.727519 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:36.727520 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:36.727586 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:36.727840 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:36.727841 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:36.727893 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 01:00:36.727965 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 01:00:36.728076 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":74,"threads_started":1}
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:00:36.752323 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42381
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:41939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:36.838510 15870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:36.838745 15870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:36.838781 15870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:36.840143 15870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:36.840204 15870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:36.840236 15870 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:00:36.840261 15870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:00:36.841915 15870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:41939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.30.190:42381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:36.842180 15870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:36.842429 15870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:36.847594 15885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:36.847689 15880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:36.847703 15881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:36.848055 15870 server_base.cc:1034] running on GCE node
I20260811 01:00:36.848258 15870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:36.848497 15870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:36.849637 15870 hybrid_clock.cc:648] HybridClock initialized: now 1786410036849623 us; error 28 us; skew 500 ppm
Aug 11 01:00:36 dist-test-slave-42z9 krb5kdc[15212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410036, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:36.852449 15870 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:00:36.852965 15870 webserver.cc:460] Webserver started at http://127.13.30.131:36683/ using document root <none> and password file <none>
I20260811 01:00:36.853181 15870 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:36.853236 15870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:36.853376 15870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:36.854604 15870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "b81c54674f2b40e4888efb29a398e706"
format_stamp: "Formatted at 2026-08-11 01:00:36 on dist-test-slave-42z9"
server_key: "2b6de614030998ccd14807cb185bd40d"
server_key_iv: "2bc2b0a44217e42c17f921ee57c9cb1e"
server_key_version: "encryptionkey@0"
I20260811 01:00:36.854977 15870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "b81c54674f2b40e4888efb29a398e706"
format_stamp: "Formatted at 2026-08-11 01:00:36 on dist-test-slave-42z9"
server_key: "2b6de614030998ccd14807cb185bd40d"
server_key_iv: "2bc2b0a44217e42c17f921ee57c9cb1e"
server_key_version: "encryptionkey@0"
I20260811 01:00:36.856528 15870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:36.857280 15900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:36.857465 15870 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:36.857563 15870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "b81c54674f2b40e4888efb29a398e706"
format_stamp: "Formatted at 2026-08-11 01:00:36 on dist-test-slave-42z9"
server_key: "2b6de614030998ccd14807cb185bd40d"
server_key_iv: "2bc2b0a44217e42c17f921ee57c9cb1e"
server_key_version: "encryptionkey@0"
I20260811 01:00:36.857638 15870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:36.869179 15870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:36.871447 15870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:36.871596 15870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:36.872169 15870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:36.872213 15870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:36.872243 15870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:36.872260 15870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:00:36 dist-test-slave-42z9 krb5kdc[15212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410036, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:36.879513 15870 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:46341
I20260811 01:00:36.879616 16094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:46341 every 8 connection(s)
I20260811 01:00:36.879911 15870 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:00:36.882414 15361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.872620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:38491 (local address 127.13.30.190:42381)
0811 01:00:36.872684 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:36.872686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:36.872867 (+ 181us) server_negotiation.cc:407] Connection header received
0811 01:00:36.873371 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:36.873373 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:36.873388 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:36.873520 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:36.874229 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.874987 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.876551 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.876855 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.876942 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.879771 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:36.879773 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:36.879773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:36.879782 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:36.881182 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.881617 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.881618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.881619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.881681 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.881882 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.881883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.881883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.882000 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:36.882051 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:36.882268 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 01:00:36.882340 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 01:00:36.882596 15915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.872580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42381 (local address 127.13.30.131:38491)
0811 01:00:36.872740 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:36.872784 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:36.873279 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:36.873627 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:36.873630 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:36.873913 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:36.874127 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.874133 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.875094 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.875096 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.876442 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.876447 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.876972 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.876973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.877144 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.877775 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:36.877788 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:36.879648 (+ 1860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:36.881258 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:36.881263 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:36.881265 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:36.881546 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:36.881738 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:36.881738 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:36.881738 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:36.881834 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:36.882048 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:36.882051 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:36.882170 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 01:00:36.882249 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 01:00:36.882379 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":90,"threads_started":1}
I20260811 01:00:36.883083 16096 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42381
I20260811 01:00:36.883163 16096 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:36.883342 16096 heartbeater.cc:511] Master 127.13.30.190:42381 requested a full tablet report, sending...
I20260811 01:00:36.883713 15275 ts_manager.cc:194] Registered new tserver with Master: b81c54674f2b40e4888efb29a398e706 (127.13.30.131:46341)
I20260811 01:00:36.884090 15275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:38491
I20260811 01:00:36.888976 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 15870
I20260811 01:00:36.889060 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:00:36.889207 13434 external_mini_cluster.cc:1428] Setting key 0147cc3e2923b2e6fb622de13271fe27
I20260811 01:00:36.889484 15361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.884200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:55277 (local address 127.13.30.190:42381)
0811 01:00:36.884248 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:36.884251 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:36.884365 (+ 114us) server_negotiation.cc:407] Connection header received
0811 01:00:36.884433 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:36.884434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:36.884444 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:36.884488 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:36.884800 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.885269 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.885991 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.886186 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.886243 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.887176 (+ 933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:36.887177 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:36.887178 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:36.887185 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:36.888356 (+ 1171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.888681 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.888682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.888682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.888739 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.888929 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.888930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.888930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.889049 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:36.889111 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:36.889277 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 01:00:36.889359 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 01:00:36.889510 16108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.884144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42381 (local address 127.13.30.131:55277)
0811 01:00:36.884287 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:36.884297 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:36.884372 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:36.884492 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:36.884493 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:36.884670 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:36.884734 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.884736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.885358 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.885359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.885911 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.885913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.886247 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.886248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.886327 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.886751 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:36.886757 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:36.887092 (+ 335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:36.888449 (+ 1357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:36.888451 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:36.888451 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:36.888619 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:36.888813 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:36.888814 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:36.888814 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:36.888880 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:36.889139 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:36.889140 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:36.889184 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 01:00:36.889241 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 01:00:36.889366 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":80,"threads_started":1}
I20260811 01:00:36.890231 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:00:36 dist-test-slave-42z9 krb5kdc[15212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410036, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:00:36 dist-test-slave-42z9 krb5kdc[15212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410036, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:36.915024 15361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.907661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44800 (local address 127.13.30.190:42381)
0811 01:00:36.907735 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:36.907738 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:36.907817 (+ 79us) server_negotiation.cc:407] Connection header received
0811 01:00:36.907898 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:36.907899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:36.907909 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:36.907958 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:36.908530 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.909034 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.909830 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.910025 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.910083 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.912278 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:36.912279 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:36.912280 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:36.912287 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:36.913666 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.914004 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.914005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.914006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.914064 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:36.914379 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:36.914382 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:36.914382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:36.914661 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:36.914765 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:36.914865 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 01:00:36.914940 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 01:00:36.916641 15277 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44800:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:00:36.918438 15277 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:00:36.925019 16137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.921027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57562 (local address 127.13.30.130:46255)
0811 01:00:36.921213 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:36.921218 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:36.921491 (+ 273us) server_negotiation.cc:407] Connection header received
0811 01:00:36.921535 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:36.921537 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:36.921551 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:36.921614 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:36.921798 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.922951 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.924060 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.924613 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.924678 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.924740 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:36.924866 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 01:00:36.924904 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":96,"threads_started":1}
I20260811 01:00:36.925019 16131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.920748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:46255 (local address 127.0.0.1:57562)
0811 01:00:36.921356 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:36.921364 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:36.921405 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:36.921693 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:36.921694 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:36.921696 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:36.921734 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.921735 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.923035 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.923036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.923964 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.923967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.924689 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.924690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.924766 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.924780 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 01:00:36.924845 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 01:00:36.924903 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"mutex_wait_us":32,"thread_start_us":111,"threads_started":1}
I20260811 01:00:36.925207 16132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.920730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40607 (local address 127.0.0.1:52364)
0811 01:00:36.921038 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:36.921081 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:36.921153 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:36.921462 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:36.921465 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:36.921468 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:36.921550 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.921552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.923020 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.923021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.924106 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.924108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.924972 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.924973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.925040 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.925044 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:00:36.925073 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 01:00:36.925109 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":43,"thread_start_us":59,"threads_started":1}
I20260811 01:00:36.925208 16135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.920944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35510 (local address 127.13.30.131:46341)
0811 01:00:36.921169 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:36.921175 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:36.921316 (+ 141us) server_negotiation.cc:407] Connection header received
0811 01:00:36.921363 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:36.921366 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:36.921384 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:36.921496 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:36.921713 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.922526 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.923907 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.924628 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.924696 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.924751 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:36.925068 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 01:00:36.925111 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":95,"threads_started":1}
I20260811 01:00:36.925159 16130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.920730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:46341 (local address 127.0.0.1:35510)
0811 01:00:36.921244 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:36.921252 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:36.921292 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:36.921574 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:36.921575 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:36.921577 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:36.921635 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.921636 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.922596 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.922597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.923815 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:36.923818 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.924788 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.924789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:36.924850 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.924855 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:00:36.924920 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 01:00:36.924965 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":2,"thread_start_us":89,"threads_started":1}
I20260811 01:00:36.925407 16134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:36.920936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52364 (local address 127.13.30.129:40607)
0811 01:00:36.921262 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:36.921266 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:36.921275 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:00:36.921315 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:36.921317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:36.921333 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:36.921682 (+ 349us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:36.921744 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.922932 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.924185 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:36.924887 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:36.925198 (+ 311us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:36.925262 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:36.925287 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 01:00:36.925323 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":82,"threads_started":1}
I20260811 01:00:36.926190 15503 tablet_service.cc:1467] Processing CreateTablet for tablet 98418900ef404b34a4ab6fff5391c2d2 (DEFAULT_TABLE table=test-table [id=e88ca0a7a69c45529319a21b60aa663a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:36.926523 15503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98418900ef404b34a4ab6fff5391c2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:36.929556 16138 tablet_bootstrap.cc:492] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef: Bootstrap starting.
I20260811 01:00:36.929956 15988 tablet_service.cc:1467] Processing CreateTablet for tablet 98418900ef404b34a4ab6fff5391c2d2 (DEFAULT_TABLE table=test-table [id=e88ca0a7a69c45529319a21b60aa663a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:36.930301 16138 tablet_bootstrap.cc:654] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:36.930330 15988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98418900ef404b34a4ab6fff5391c2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:36.930644 16138 log.cc:824] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:36.931420 16138 tablet_bootstrap.cc:492] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef: No bootstrap required, opened a new log
I20260811 01:00:36.931499 16138 ts_tablet_manager.cc:1397] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:00:36.933584 16138 raft_consensus.cc:348] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } }
I20260811 01:00:36.933808 16138 raft_consensus.cc:374] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:36.933892 16138 raft_consensus.cc:729] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2695c03ef84db5af9498e77d7e83ef, State: Initialized, Role: FOLLOWER
I20260811 01:00:36.934132 16138 consensus_queue.cc:260] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } }
I20260811 01:00:36.934203 15749 tablet_service.cc:1467] Processing CreateTablet for tablet 98418900ef404b34a4ab6fff5391c2d2 (DEFAULT_TABLE table=test-table [id=e88ca0a7a69c45529319a21b60aa663a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:36.934394 16138 ts_tablet_manager.cc:1428] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:00:36.934427 15619 heartbeater.cc:503] Master 127.13.30.190:42381 was elected leader, sending a full tablet report...
I20260811 01:00:36.934602 15749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98418900ef404b34a4ab6fff5391c2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:36.934602 16141 tablet_bootstrap.cc:492] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706: Bootstrap starting.
I20260811 01:00:36.935626 16141 tablet_bootstrap.cc:654] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:36.935896 16141 log.cc:824] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:36.936734 16141 tablet_bootstrap.cc:492] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706: No bootstrap required, opened a new log
I20260811 01:00:36.936789 16141 ts_tablet_manager.cc:1397] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:00:36.937623 16146 tablet_bootstrap.cc:492] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad: Bootstrap starting.
I20260811 01:00:36.938220 16146 tablet_bootstrap.cc:654] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:36.938511 16146 log.cc:824] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:36.938862 16141 raft_consensus.cc:348] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } }
I20260811 01:00:36.939004 16141 raft_consensus.cc:374] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:36.939024 16141 raft_consensus.cc:729] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c54674f2b40e4888efb29a398e706, State: Initialized, Role: FOLLOWER
I20260811 01:00:36.939131 16141 consensus_queue.cc:260] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } }
I20260811 01:00:36.939208 16146 tablet_bootstrap.cc:492] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad: No bootstrap required, opened a new log
I20260811 01:00:36.939291 16146 ts_tablet_manager.cc:1397] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:00:36.939420 16141 ts_tablet_manager.cc:1428] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 01:00:36.939472 16096 heartbeater.cc:503] Master 127.13.30.190:42381 was elected leader, sending a full tablet report...
I20260811 01:00:36.941385 16146 raft_consensus.cc:348] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } }
I20260811 01:00:36.941581 16146 raft_consensus.cc:374] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:36.941624 16146 raft_consensus.cc:729] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76420d0098b24b0d8cebfc124f43e9ad, State: Initialized, Role: FOLLOWER
I20260811 01:00:36.941761 16146 consensus_queue.cc:260] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } }
I20260811 01:00:36.942060 16146 ts_tablet_manager.cc:1428] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:00:36.942106 15855 heartbeater.cc:503] Master 127.13.30.190:42381 was elected leader, sending a full tablet report...
W20260811 01:00:36.969087 15856 tablet.cc:2369] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:00:37.055873 15620 tablet.cc:2369] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:00:37.057648 16150 raft_consensus.cc:482] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:00:37.057771 16150 raft_consensus.cc:504] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } }
I20260811 01:00:37.058157 16150 leader_election.cc:288] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a2695c03ef84db5af9498e77d7e83ef (127.13.30.129:40607), 76420d0098b24b0d8cebfc124f43e9ad (127.13.30.130:46255)
I20260811 01:00:37.062381 16137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.058518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:36905 (local address 127.13.30.130:46255)
0811 01:00:37.058569 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:37.058571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:37.058671 (+ 100us) server_negotiation.cc:407] Connection header received
0811 01:00:37.058713 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:37.058714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:37.058723 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:37.058768 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:37.059019 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.059739 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.061304 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.061940 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.062017 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.062027 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:37.062246 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 01:00:37.062301 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 01:00:37.062381 16134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.058457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:45847 (local address 127.13.30.129:40607)
0811 01:00:37.058500 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:37.058501 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:37.058540 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:00:37.058635 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:37.058636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:37.058644 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:37.058707 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:37.058885 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.059707 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.061288 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.061940 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.062017 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.062027 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:37.062246 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 01:00:37.062302 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 01:00:37.062407 15915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.058389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40607 (local address 127.13.30.131:45847)
0811 01:00:37.058470 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:37.058483 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:37.058558 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:37.058720 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:37.058720 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:37.058722 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:37.058813 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:37.058815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.059792 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.059793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:37.061196 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:37.061201 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.062022 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.062023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:37.062134 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.062137 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:00:37.062193 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 01:00:37.062261 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":73}
I20260811 01:00:37.062412 16154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.058391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:46255 (local address 127.13.30.131:36905)
0811 01:00:37.058603 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:37.058612 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:37.058665 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:37.058778 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:37.058778 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:37.058780 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:37.058951 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:37.058953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.059814 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.059815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:37.061196 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:37.061201 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.062022 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.062023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:37.062131 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.062135 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:00:37.062193 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 01:00:37.062261 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":103,"thread_start_us":104,"threads_started":1}
I20260811 01:00:37.062902 15537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98418900ef404b34a4ab6fff5391c2d2" candidate_uuid: "b81c54674f2b40e4888efb29a398e706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2695c03ef84db5af9498e77d7e83ef" is_pre_election: true
I20260811 01:00:37.062960 15780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98418900ef404b34a4ab6fff5391c2d2" candidate_uuid: "b81c54674f2b40e4888efb29a398e706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76420d0098b24b0d8cebfc124f43e9ad" is_pre_election: true
I20260811 01:00:37.063086 15537 raft_consensus.cc:2454] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c54674f2b40e4888efb29a398e706 in term 0.
I20260811 01:00:37.063102 15780 raft_consensus.cc:2454] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b81c54674f2b40e4888efb29a398e706 in term 0.
I20260811 01:00:37.063334 15906 leader_election.cc:302] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a2695c03ef84db5af9498e77d7e83ef, b81c54674f2b40e4888efb29a398e706; no voters:
I20260811 01:00:37.063513 16150 raft_consensus.cc:2781] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:00:37.063555 16150 raft_consensus.cc:482] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:00:37.063570 16150 raft_consensus.cc:3037] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:37.064738 16150 raft_consensus.cc:504] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } }
I20260811 01:00:37.064888 16150 leader_election.cc:288] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [CANDIDATE]: Term 1 election: Requested vote from peers 6a2695c03ef84db5af9498e77d7e83ef (127.13.30.129:40607), 76420d0098b24b0d8cebfc124f43e9ad (127.13.30.130:46255)
I20260811 01:00:37.065090 15780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98418900ef404b34a4ab6fff5391c2d2" candidate_uuid: "b81c54674f2b40e4888efb29a398e706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76420d0098b24b0d8cebfc124f43e9ad"
I20260811 01:00:37.065074 15537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98418900ef404b34a4ab6fff5391c2d2" candidate_uuid: "b81c54674f2b40e4888efb29a398e706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2695c03ef84db5af9498e77d7e83ef"
I20260811 01:00:37.065166 15537 raft_consensus.cc:3037] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:37.065171 15780 raft_consensus.cc:3037] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:37.066092 15537 raft_consensus.cc:2454] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c54674f2b40e4888efb29a398e706 in term 1.
I20260811 01:00:37.066263 15906 leader_election.cc:302] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a2695c03ef84db5af9498e77d7e83ef, b81c54674f2b40e4888efb29a398e706; no voters:
I20260811 01:00:37.066305 15780 raft_consensus.cc:2454] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b81c54674f2b40e4888efb29a398e706 in term 1.
I20260811 01:00:37.066402 16150 raft_consensus.cc:2781] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:37.066577 16150 raft_consensus.cc:686] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [term 1 LEADER]: Becoming Leader. State: Replica: b81c54674f2b40e4888efb29a398e706, State: Running, Role: LEADER
I20260811 01:00:37.066680 16150 consensus_queue.cc:237] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } }
I20260811 01:00:37.067596 15277 catalog_manager.cc:5495] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 reported cstate change: term changed from 0 to 1, leader changed from <none> to b81c54674f2b40e4888efb29a398e706 (127.13.30.131). New cstate: current_term: 1 leader_uuid: "b81c54674f2b40e4888efb29a398e706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } health_report { overall_health: UNKNOWN } } }
I20260811 01:00:37.108939 16135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.106305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35524 (local address 127.13.30.131:46341)
0811 01:00:37.106370 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:37.106372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:37.106382 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:00:37.106519 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:37.106520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:37.106538 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:37.106594 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:37.106754 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.107244 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.108035 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.108229 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.108288 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.108516 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:37.108646 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:37.108723 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:37.108798 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 01:00:37.108827 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 01:00:37.111104 15537 raft_consensus.cc:1261] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef [term 1 FOLLOWER]: Refusing update from remote peer b81c54674f2b40e4888efb29a398e706: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:37.111471 16156 consensus_queue.cc:1035] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:37.113752 15780 raft_consensus.cc:1261] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad [term 1 FOLLOWER]: Refusing update from remote peer b81c54674f2b40e4888efb29a398e706: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:37.114190 16156 consensus_queue.cc:1035] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:37.115756 16169 mvcc.cc:205] Tried to move back new op lower bound from 7317135512004009984 to 7317135511825903616. Current Snapshot: MvccSnapshot[applied={T|T < 7317135512004009984}]
I20260811 01:00:37.118554 15275 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44800:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:37.118675 15275 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44800:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:37.119617 15275 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99: Sending DeleteTablet for 3 replicas of tablet 98418900ef404b34a4ab6fff5391c2d2
I20260811 01:00:37.120097 15988 tablet_service.cc:1514] Processing DeleteTablet for tablet 98418900ef404b34a4ab6fff5391c2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:37 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:35510
I20260811 01:00:37.120098 15749 tablet_service.cc:1514] Processing DeleteTablet for tablet 98418900ef404b34a4ab6fff5391c2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:37 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:57562
I20260811 01:00:37.120525 16174 tablet_replica.cc:330] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706: stopping tablet replica
I20260811 01:00:37.120572 15503 tablet_service.cc:1514] Processing DeleteTablet for tablet 98418900ef404b34a4ab6fff5391c2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:37 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:52364
I20260811 01:00:37.120757 15275 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44800:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 01:00:37.120839 16179 tablet_replica.cc:330] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef: stopping tablet replica
W20260811 01:00:37.120920 15275 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:00:37.120966 16179 raft_consensus.cc:2229] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:37.121093 16179 raft_consensus.cc:2258] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:37.121176 16175 tablet_replica.cc:330] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad: stopping tablet replica
I20260811 01:00:37.121413 16175 raft_consensus.cc:2229] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:37.121554 16175 raft_consensus.cc:2258] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:37.121640 16179 ts_tablet_manager.cc:1905] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:37.122092 16175 ts_tablet_manager.cc:1905] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:37.122969 15503 tablet_service.cc:1467] Processing CreateTablet for tablet 0f84388d00124157ab38ccf95d3fe609 (DEFAULT_TABLE table=test-table [id=2e17d7483ea94c869d2310996a798240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:37.123077 15503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f84388d00124157ab38ccf95d3fe609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:37.123554 16179 ts_tablet_manager.cc:1918] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:00:37.123622 16179 log.cc:1196] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/wal/wals/98418900ef404b34a4ab6fff5391c2d2
I20260811 01:00:37.123869 16179 ts_tablet_manager.cc:1939] T 98418900ef404b34a4ab6fff5391c2d2 P 6a2695c03ef84db5af9498e77d7e83ef: Deleting consensus metadata
I20260811 01:00:37.123909 16175 ts_tablet_manager.cc:1918] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:00:37.123983 16175 log.cc:1196] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/98418900ef404b34a4ab6fff5391c2d2
I20260811 01:00:37.124231 16175 ts_tablet_manager.cc:1939] T 98418900ef404b34a4ab6fff5391c2d2 P 76420d0098b24b0d8cebfc124f43e9ad: Deleting consensus metadata
I20260811 01:00:37.124281 15749 tablet_service.cc:1467] Processing CreateTablet for tablet 0f84388d00124157ab38ccf95d3fe609 (DEFAULT_TABLE table=test-table [id=2e17d7483ea94c869d2310996a798240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:37.124323 15255 catalog_manager.cc:4841] TS 6a2695c03ef84db5af9498e77d7e83ef (127.13.30.129:40607): tablet 98418900ef404b34a4ab6fff5391c2d2 (table test-table [id=e88ca0a7a69c45529319a21b60aa663a]) successfully deleted
I20260811 01:00:37.124401 15749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f84388d00124157ab38ccf95d3fe609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:37.124645 15253 catalog_manager.cc:4841] TS 76420d0098b24b0d8cebfc124f43e9ad (127.13.30.130:46255): tablet 98418900ef404b34a4ab6fff5391c2d2 (table test-table [id=e88ca0a7a69c45529319a21b60aa663a]) successfully deleted
I20260811 01:00:37.125491 16146 tablet_bootstrap.cc:492] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad: Bootstrap starting.
I20260811 01:00:37.125501 16138 tablet_bootstrap.cc:492] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef: Bootstrap starting.
I20260811 01:00:37.126034 16138 tablet_bootstrap.cc:654] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:37.126034 16146 tablet_bootstrap.cc:654] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:37.126883 16146 tablet_bootstrap.cc:492] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad: No bootstrap required, opened a new log
I20260811 01:00:37.126940 16146 ts_tablet_manager.cc:1397] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:37.127120 16146 raft_consensus.cc:348] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.127202 16146 raft_consensus.cc:374] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:37.127221 16146 raft_consensus.cc:729] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76420d0098b24b0d8cebfc124f43e9ad, State: Initialized, Role: FOLLOWER
I20260811 01:00:37.127260 16146 consensus_queue.cc:260] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.127364 16146 ts_tablet_manager.cc:1428] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 01:00:37.127434 16138 tablet_bootstrap.cc:492] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef: No bootstrap required, opened a new log
I20260811 01:00:37.127476 16138 ts_tablet_manager.cc:1397] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:00:37.127667 16138 raft_consensus.cc:348] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.127737 16138 raft_consensus.cc:374] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:37.127758 16138 raft_consensus.cc:729] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2695c03ef84db5af9498e77d7e83ef, State: Initialized, Role: FOLLOWER
I20260811 01:00:37.127799 16138 consensus_queue.cc:260] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.127900 16138 ts_tablet_manager.cc:1428] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:37.126802 15988 tablet_service.cc:1467] Processing CreateTablet for tablet 0f84388d00124157ab38ccf95d3fe609 (DEFAULT_TABLE table=test-table [id=2e17d7483ea94c869d2310996a798240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:37.128175 15988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f84388d00124157ab38ccf95d3fe609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:37.129563 16141 tablet_bootstrap.cc:492] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706: Bootstrap starting.
I20260811 01:00:37.129645 16174 raft_consensus.cc:2229] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:00:37.129837 16174 raft_consensus.cc:2258] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:37.130017 16141 tablet_bootstrap.cc:654] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:37.130342 16174 ts_tablet_manager.cc:1905] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:37.130846 16141 tablet_bootstrap.cc:492] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706: No bootstrap required, opened a new log
I20260811 01:00:37.130895 16141 ts_tablet_manager.cc:1397] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:37.131110 16141 raft_consensus.cc:348] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.131174 16141 raft_consensus.cc:374] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:37.131186 16141 raft_consensus.cc:729] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c54674f2b40e4888efb29a398e706, State: Initialized, Role: FOLLOWER
I20260811 01:00:37.131222 16141 consensus_queue.cc:260] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.131302 16141 ts_tablet_manager.cc:1428] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:37.132000 16174 ts_tablet_manager.cc:1918] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:00:37.132079 16174 log.cc:1196] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/98418900ef404b34a4ab6fff5391c2d2
I20260811 01:00:37.132355 16174 ts_tablet_manager.cc:1939] T 98418900ef404b34a4ab6fff5391c2d2 P b81c54674f2b40e4888efb29a398e706: Deleting consensus metadata
I20260811 01:00:37.132763 15254 catalog_manager.cc:4841] TS b81c54674f2b40e4888efb29a398e706 (127.13.30.131:46341): tablet 98418900ef404b34a4ab6fff5391c2d2 (table test-table [id=e88ca0a7a69c45529319a21b60aa663a]) successfully deleted
I20260811 01:00:37.160512 16144 raft_consensus.cc:482] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:00:37.160640 16144 raft_consensus.cc:504] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.161022 16144 leader_election.cc:288] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76420d0098b24b0d8cebfc124f43e9ad (127.13.30.130:46255), b81c54674f2b40e4888efb29a398e706 (127.13.30.131:46341)
I20260811 01:00:37.164624 16187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.161208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:46255 (local address 127.13.30.129:35605)
0811 01:00:37.161347 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:37.161358 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:37.161486 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:37.161808 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:37.161809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:37.161811 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:37.161898 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:37.161900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.162740 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.162742 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:37.163596 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:37.163600 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.164351 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.164352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:37.164426 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.164430 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:00:37.164479 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 01:00:37.164520 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":66,"threads_started":1}
I20260811 01:00:37.164633 16137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.161612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:35605 (local address 127.13.30.130:46255)
0811 01:00:37.161665 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:37.161667 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:37.161676 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:00:37.161703 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:37.161704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:37.161712 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:37.161760 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:37.161972 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.162680 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.163717 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.164224 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.164267 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.164277 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:37.164504 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 01:00:37.164557 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 01:00:37.165023 15780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f84388d00124157ab38ccf95d3fe609" candidate_uuid: "6a2695c03ef84db5af9498e77d7e83ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76420d0098b24b0d8cebfc124f43e9ad" is_pre_election: true
I20260811 01:00:37.165136 15780 raft_consensus.cc:2454] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a2695c03ef84db5af9498e77d7e83ef in term 0.
I20260811 01:00:37.165161 16188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.161227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:46341 (local address 127.13.30.129:54485)
0811 01:00:37.161465 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:37.161476 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:37.161543 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:37.161712 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:37.161713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:37.161716 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:37.161791 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:37.161793 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.162679 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.162680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:37.164058 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:37.164062 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.164886 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.164887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:37.164977 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.164981 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:00:37.165036 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 01:00:37.165075 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":37,"thread_start_us":145,"threads_started":1}
I20260811 01:00:37.165180 16135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.161544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:54485 (local address 127.13.30.131:46341)
0811 01:00:37.161603 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:37.161605 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:37.161614 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:00:37.161644 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:37.161645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:37.161655 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:37.161705 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:37.161855 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.162583 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.164168 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.164690 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.164760 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.164770 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:37.165059 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 01:00:37.165112 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 01:00:37.165500 15428 leader_election.cc:302] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a2695c03ef84db5af9498e77d7e83ef, 76420d0098b24b0d8cebfc124f43e9ad; no voters:
I20260811 01:00:37.165426 16021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f84388d00124157ab38ccf95d3fe609" candidate_uuid: "6a2695c03ef84db5af9498e77d7e83ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c54674f2b40e4888efb29a398e706" is_pre_election: true
I20260811 01:00:37.165627 16021 raft_consensus.cc:2454] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a2695c03ef84db5af9498e77d7e83ef in term 0.
I20260811 01:00:37.165750 16144 raft_consensus.cc:2781] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:00:37.165800 16144 raft_consensus.cc:482] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:00:37.165819 16144 raft_consensus.cc:3037] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:37.166888 16144 raft_consensus.cc:504] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.167045 16144 leader_election.cc:288] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [CANDIDATE]: Term 1 election: Requested vote from peers 76420d0098b24b0d8cebfc124f43e9ad (127.13.30.130:46255), b81c54674f2b40e4888efb29a398e706 (127.13.30.131:46341)
I20260811 01:00:37.167222 16021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f84388d00124157ab38ccf95d3fe609" candidate_uuid: "6a2695c03ef84db5af9498e77d7e83ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c54674f2b40e4888efb29a398e706"
I20260811 01:00:37.167223 15780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f84388d00124157ab38ccf95d3fe609" candidate_uuid: "6a2695c03ef84db5af9498e77d7e83ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76420d0098b24b0d8cebfc124f43e9ad"
I20260811 01:00:37.167315 16021 raft_consensus.cc:3037] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:37.167315 15780 raft_consensus.cc:3037] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:37.168222 15780 raft_consensus.cc:2454] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2695c03ef84db5af9498e77d7e83ef in term 1.
I20260811 01:00:37.168222 16021 raft_consensus.cc:2454] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2695c03ef84db5af9498e77d7e83ef in term 1.
I20260811 01:00:37.168423 15428 leader_election.cc:302] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a2695c03ef84db5af9498e77d7e83ef, 76420d0098b24b0d8cebfc124f43e9ad; no voters:
I20260811 01:00:37.168524 16144 raft_consensus.cc:2781] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:37.168694 16144 raft_consensus.cc:686] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [term 1 LEADER]: Becoming Leader. State: Replica: 6a2695c03ef84db5af9498e77d7e83ef, State: Running, Role: LEADER
I20260811 01:00:37.168780 16144 consensus_queue.cc:237] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.170027 15277 catalog_manager.cc:5495] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a2695c03ef84db5af9498e77d7e83ef (127.13.30.129). New cstate: current_term: 1 leader_uuid: "6a2695c03ef84db5af9498e77d7e83ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } health_report { overall_health: UNKNOWN } } }
Aug 11 01:00:37 dist-test-slave-42z9 krb5kdc[15212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410036, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:37.205680 15361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.198290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44802 (local address 127.13.30.190:42381)
0811 01:00:37.198355 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:37.198358 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:37.198493 (+ 135us) server_negotiation.cc:407] Connection header received
0811 01:00:37.198573 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:37.198574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:37.198583 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:37.198633 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:37.199246 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.199743 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.200763 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.200950 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.201003 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.203320 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:37.203321 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:37.203321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:37.203329 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:37.204568 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:37.204918 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:37.204919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:37.204920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:37.204969 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:37.205128 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:37.205129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:37.205129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:37.205239 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:37.205294 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:37.205465 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 01:00:37.205559 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 01:00:37.205757 16202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.198205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42381 (local address 127.0.0.1:44802)
0811 01:00:37.198409 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:37.198422 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:37.198510 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:37.198660 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:37.198661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:37.199096 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:37.199165 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:37.199168 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.199822 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.199823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:37.200677 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:37.200680 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.201031 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.201032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:37.201094 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.201701 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:37.201707 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:37.203241 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:37.204645 (+ 1404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:37.204653 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:37.204655 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:37.204847 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:37.205021 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:37.205022 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:37.205022 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:37.205081 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:37.205293 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:37.205301 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:37.205350 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 01:00:37.205417 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 01:00:37.205630 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":72,"thread_start_us":98,"threads_started":1}
I20260811 01:00:37.208278 15277 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:44802:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 01:00:37.208617 15277 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:00:37.210412 15749 tablet_service.cc:1467] Processing CreateTablet for tablet 9af71981fa13483987bb98c071bc4fc8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bcb34ee13c3b4568b9d5566087806feb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:00:37.210515 15503 tablet_service.cc:1467] Processing CreateTablet for tablet 9af71981fa13483987bb98c071bc4fc8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bcb34ee13c3b4568b9d5566087806feb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:00:37.210659 15503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9af71981fa13483987bb98c071bc4fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:37.210660 15749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9af71981fa13483987bb98c071bc4fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:37.210407 15988 tablet_service.cc:1467] Processing CreateTablet for tablet 9af71981fa13483987bb98c071bc4fc8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bcb34ee13c3b4568b9d5566087806feb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:00:37.212023 15988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9af71981fa13483987bb98c071bc4fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:37.212301 16146 tablet_bootstrap.cc:492] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad: Bootstrap starting.
I20260811 01:00:37.212314 16138 tablet_bootstrap.cc:492] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef: Bootstrap starting.
I20260811 01:00:37.212795 16146 tablet_bootstrap.cc:654] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:37.212803 16138 tablet_bootstrap.cc:654] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:37.214140 16141 tablet_bootstrap.cc:492] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706: Bootstrap starting.
I20260811 01:00:37.214210 16146 tablet_bootstrap.cc:492] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad: No bootstrap required, opened a new log
I20260811 01:00:37.214249 16146 ts_tablet_manager.cc:1397] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 01:00:37.214478 16146 raft_consensus.cc:348] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.214584 16146 raft_consensus.cc:374] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:37.214607 16146 raft_consensus.cc:729] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76420d0098b24b0d8cebfc124f43e9ad, State: Initialized, Role: FOLLOWER
I20260811 01:00:37.214661 16146 consensus_queue.cc:260] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.214759 16146 ts_tablet_manager.cc:1428] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:37.214849 16141 tablet_bootstrap.cc:654] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:37.214886 16152 tablet_replica.cc:439] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } }
I20260811 01:00:37.214989 16152 tablet_replica.cc:442] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:00:37.215253 16138 tablet_bootstrap.cc:492] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef: No bootstrap required, opened a new log
I20260811 01:00:37.215297 16138 ts_tablet_manager.cc:1397] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 01:00:37.215446 16138 raft_consensus.cc:348] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.215524 16138 raft_consensus.cc:374] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:37.215540 16138 raft_consensus.cc:729] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2695c03ef84db5af9498e77d7e83ef, State: Initialized, Role: FOLLOWER
I20260811 01:00:37.215575 16138 consensus_queue.cc:260] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.215658 16138 ts_tablet_manager.cc:1428] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:37.215720 16144 tablet_replica.cc:439] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } }
I20260811 01:00:37.215833 16144 tablet_replica.cc:442] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:00:37.216135 16141 tablet_bootstrap.cc:492] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706: No bootstrap required, opened a new log
I20260811 01:00:37.216188 16141 ts_tablet_manager.cc:1397] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 01:00:37.216363 16141 raft_consensus.cc:348] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.216439 16141 raft_consensus.cc:374] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:37.216461 16141 raft_consensus.cc:729] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c54674f2b40e4888efb29a398e706, State: Initialized, Role: FOLLOWER
I20260811 01:00:37.216502 16141 consensus_queue.cc:260] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.216593 16141 ts_tablet_manager.cc:1428] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 01:00:37.216679 16156 tablet_replica.cc:439] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } }
I20260811 01:00:37.216746 16156 tablet_replica.cc:442] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:00:37.257050 16144 raft_consensus.cc:482] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:00:37.257177 16144 raft_consensus.cc:504] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.257329 16144 leader_election.cc:288] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76420d0098b24b0d8cebfc124f43e9ad (127.13.30.130:46255), b81c54674f2b40e4888efb29a398e706 (127.13.30.131:46341)
I20260811 01:00:37.257614 16021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9af71981fa13483987bb98c071bc4fc8" candidate_uuid: "6a2695c03ef84db5af9498e77d7e83ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c54674f2b40e4888efb29a398e706" is_pre_election: true
I20260811 01:00:37.257623 15780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9af71981fa13483987bb98c071bc4fc8" candidate_uuid: "6a2695c03ef84db5af9498e77d7e83ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76420d0098b24b0d8cebfc124f43e9ad" is_pre_election: true
I20260811 01:00:37.257706 16021 raft_consensus.cc:2454] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a2695c03ef84db5af9498e77d7e83ef in term 0.
I20260811 01:00:37.257723 15780 raft_consensus.cc:2454] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a2695c03ef84db5af9498e77d7e83ef in term 0.
I20260811 01:00:37.257890 15429 leader_election.cc:302] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a2695c03ef84db5af9498e77d7e83ef, b81c54674f2b40e4888efb29a398e706; no voters:
I20260811 01:00:37.258041 16144 raft_consensus.cc:2781] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:00:37.258085 16144 raft_consensus.cc:482] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:00:37.258105 16144 raft_consensus.cc:3037] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:37.258841 16144 raft_consensus.cc:504] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.258984 16144 leader_election.cc:288] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [CANDIDATE]: Term 1 election: Requested vote from peers 76420d0098b24b0d8cebfc124f43e9ad (127.13.30.130:46255), b81c54674f2b40e4888efb29a398e706 (127.13.30.131:46341)
I20260811 01:00:37.259160 15780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9af71981fa13483987bb98c071bc4fc8" candidate_uuid: "6a2695c03ef84db5af9498e77d7e83ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76420d0098b24b0d8cebfc124f43e9ad"
I20260811 01:00:37.259174 16021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9af71981fa13483987bb98c071bc4fc8" candidate_uuid: "6a2695c03ef84db5af9498e77d7e83ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c54674f2b40e4888efb29a398e706"
I20260811 01:00:37.259250 16021 raft_consensus.cc:3037] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:37.259253 15780 raft_consensus.cc:3037] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:37.259920 15780 raft_consensus.cc:2454] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2695c03ef84db5af9498e77d7e83ef in term 1.
I20260811 01:00:37.260074 16021 raft_consensus.cc:2454] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2695c03ef84db5af9498e77d7e83ef in term 1.
I20260811 01:00:37.260124 15428 leader_election.cc:302] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a2695c03ef84db5af9498e77d7e83ef, 76420d0098b24b0d8cebfc124f43e9ad; no voters:
I20260811 01:00:37.260210 16144 raft_consensus.cc:2781] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:37.260262 16144 raft_consensus.cc:686] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [term 1 LEADER]: Becoming Leader. State: Replica: 6a2695c03ef84db5af9498e77d7e83ef, State: Running, Role: LEADER
I20260811 01:00:37.260331 16144 consensus_queue.cc:237] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } }
I20260811 01:00:37.260686 16189 tablet_replica.cc:439] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef: TxnStatusTablet state changed. Reason: New leader 6a2695c03ef84db5af9498e77d7e83ef. Latest consensus state: current_term: 1 leader_uuid: "6a2695c03ef84db5af9498e77d7e83ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } }
I20260811 01:00:37.260784 16189 tablet_replica.cc:442] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:00:37.260984 15277 catalog_manager.cc:5495] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a2695c03ef84db5af9498e77d7e83ef (127.13.30.129). New cstate: current_term: 1 leader_uuid: "6a2695c03ef84db5af9498e77d7e83ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } health_report { overall_health: UNKNOWN } } }
I20260811 01:00:37.261085 16213 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 01:00:37.261216 16213 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 01:00:37.277801 16134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.275305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52368 (local address 127.13.30.129:40607)
0811 01:00:37.275359 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:37.275361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:37.275370 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:00:37.275432 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:37.275433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:37.275452 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:37.275503 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:37.275632 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.276199 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.276963 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.277162 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.277218 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.277413 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:37.277569 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:37.277637 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:37.277687 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 01:00:37.277712 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 01:00:37.277824 16202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.275220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40607 (local address 127.0.0.1:52368)
0811 01:00:37.275292 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:37.275304 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:37.275355 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:37.275516 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:37.275517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:37.275519 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:00:37.275573 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:37.275576 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.276271 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.276272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:37.276878 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:37.276880 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.277229 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.277230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:37.277306 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.277323 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:00:37.277628 (+ 305us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:00:37.277639 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 01:00:37.277684 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 01:00:37.277741 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 01:00:37.279237 15780 raft_consensus.cc:1261] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad [term 1 FOLLOWER]: Refusing update from remote peer 6a2695c03ef84db5af9498e77d7e83ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:37.279429 16021 raft_consensus.cc:1261] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706 [term 1 FOLLOWER]: Refusing update from remote peer 6a2695c03ef84db5af9498e77d7e83ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:37.279570 16189 consensus_queue.cc:1035] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:37.279698 16144 consensus_queue.cc:1035] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:37.280388 16152 tablet_replica.cc:439] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad: TxnStatusTablet state changed. Reason: New leader 6a2695c03ef84db5af9498e77d7e83ef. Latest consensus state: current_term: 1 leader_uuid: "6a2695c03ef84db5af9498e77d7e83ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } }
I20260811 01:00:37.280416 16156 tablet_replica.cc:439] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706: TxnStatusTablet state changed. Reason: New leader 6a2695c03ef84db5af9498e77d7e83ef. Latest consensus state: current_term: 1 leader_uuid: "6a2695c03ef84db5af9498e77d7e83ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } }
I20260811 01:00:37.280505 16156 tablet_replica.cc:442] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:00:37.280506 16152 tablet_replica.cc:442] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:00:37.281387 16189 tablet_replica.cc:439] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6a2695c03ef84db5af9498e77d7e83ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } }
I20260811 01:00:37.281522 16189 tablet_replica.cc:442] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:00:37.281595 16162 mvcc.cc:205] Tried to move back new op lower bound from 7317135512693567488 to 7317135512618790912. Current Snapshot: MvccSnapshot[applied={T|T < 7317135512693567488 or (T in {7317135512693567488})}]
I20260811 01:00:37.281838 16144 tablet_replica.cc:439] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6a2695c03ef84db5af9498e77d7e83ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } }
I20260811 01:00:37.281924 16144 tablet_replica.cc:442] T 9af71981fa13483987bb98c071bc4fc8 P 6a2695c03ef84db5af9498e77d7e83ef: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:00:37.282105 16152 tablet_replica.cc:439] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6a2695c03ef84db5af9498e77d7e83ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } }
I20260811 01:00:37.282197 16152 tablet_replica.cc:442] T 9af71981fa13483987bb98c071bc4fc8 P 76420d0098b24b0d8cebfc124f43e9ad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:00:37.283337 16156 tablet_replica.cc:439] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6a2695c03ef84db5af9498e77d7e83ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2695c03ef84db5af9498e77d7e83ef" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40607 } } peers { permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 } } peers { permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 } } }
I20260811 01:00:37.283454 16156 tablet_replica.cc:442] T 9af71981fa13483987bb98c071bc4fc8 P b81c54674f2b40e4888efb29a398e706: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:00:37.283345 16161 mvcc.cc:205] Tried to move back new op lower bound from 7317135512693567488 to 7317135512618790912. Current Snapshot: MvccSnapshot[applied={T|T < 7317135512693567488}]
I20260811 01:00:37.286789 16134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.284573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52370 (local address 127.13.30.129:40607)
0811 01:00:37.284612 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:37.284614 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:37.284620 (+ 6us) server_negotiation.cc:407] Connection header received
0811 01:00:37.284643 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:37.284644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:37.284654 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:37.284697 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:37.284834 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.285360 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.286142 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.286355 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.286412 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.286550 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:37.286589 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:37.286631 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:37.286683 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 01:00:37.286709 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 01:00:37.293315 16134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.290813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:32801 (local address 127.13.30.129:40607)
0811 01:00:37.290858 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:37.290860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:37.290991 (+ 131us) server_negotiation.cc:407] Connection header received
0811 01:00:37.291042 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:37.291043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:37.291054 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:37.291105 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:37.291247 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.291719 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.292658 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.292839 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.292895 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.293064 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:37.293094 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:37.293137 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:37.293187 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 01:00:37.293215 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":20}
I20260811 01:00:37.293507 16223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.290717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40607 (local address 127.13.30.129:32801)
0811 01:00:37.290925 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:37.290933 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:37.290993 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:37.291101 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:37.291101 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:37.291103 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:00:37.291195 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:37.291197 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.291795 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.291796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:37.292570 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:37.292573 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.292914 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.292915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:37.292971 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.292990 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:00:37.293145 (+ 155us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:00:37.293146 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 01:00:37.293186 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 01:00:37.293234 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":2,"thread_start_us":94,"threads_started":1}
I20260811 01:00:37.295884 16021 raft_consensus.cc:1261] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706 [term 1 FOLLOWER]: Refusing update from remote peer 6a2695c03ef84db5af9498e77d7e83ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:37.295955 15780 raft_consensus.cc:1261] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad [term 1 FOLLOWER]: Refusing update from remote peer 6a2695c03ef84db5af9498e77d7e83ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:37.296154 16224 consensus_queue.cc:1035] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c54674f2b40e4888efb29a398e706" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 46341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:37.296350 16144 consensus_queue.cc:1035] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "76420d0098b24b0d8cebfc124f43e9ad" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:37.311755 15277 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44800:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:37.311868 15277 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44800:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:37.312512 15277 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8be853676e9546d3a7ddd2fba1281d99: Sending DeleteTablet for 3 replicas of tablet 0f84388d00124157ab38ccf95d3fe609
I20260811 01:00:37.312814 15503 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f84388d00124157ab38ccf95d3fe609 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:37 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:52364
I20260811 01:00:37.312836 15749 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f84388d00124157ab38ccf95d3fe609 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:37 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:57562
I20260811 01:00:37.312915 16179 tablet_replica.cc:330] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef: stopping tablet replica
I20260811 01:00:37.312966 16179 raft_consensus.cc:2229] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:00:37.312961 16175 tablet_replica.cc:330] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad: stopping tablet replica
I20260811 01:00:37.313030 16175 raft_consensus.cc:2229] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:37.313088 16179 raft_consensus.cc:2258] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:37.313128 16175 raft_consensus.cc:2258] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:37.313216 15988 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f84388d00124157ab38ccf95d3fe609 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:37 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:35510
I20260811 01:00:37.313378 16174 tablet_replica.cc:330] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706: stopping tablet replica
I20260811 01:00:37.313457 16174 raft_consensus.cc:2229] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:37.313422 16179 ts_tablet_manager.cc:1905] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:37.313549 16174 raft_consensus.cc:2258] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:37.314106 16174 ts_tablet_manager.cc:1905] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:37.315191 16179 ts_tablet_manager.cc:1918] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:00:37.315249 16179 log.cc:1196] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-0/wal/wals/0f84388d00124157ab38ccf95d3fe609
I20260811 01:00:37.315454 16179 ts_tablet_manager.cc:1939] T 0f84388d00124157ab38ccf95d3fe609 P 6a2695c03ef84db5af9498e77d7e83ef: Deleting consensus metadata
I20260811 01:00:37.315685 16174 ts_tablet_manager.cc:1918] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:00:37.315747 16174 log.cc:1196] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/0f84388d00124157ab38ccf95d3fe609
I20260811 01:00:37.315940 16174 ts_tablet_manager.cc:1939] T 0f84388d00124157ab38ccf95d3fe609 P b81c54674f2b40e4888efb29a398e706: Deleting consensus metadata
I20260811 01:00:37.316079 15255 catalog_manager.cc:4841] TS 6a2695c03ef84db5af9498e77d7e83ef (127.13.30.129:40607): tablet 0f84388d00124157ab38ccf95d3fe609 (table test-table [id=2e17d7483ea94c869d2310996a798240]) successfully deleted
I20260811 01:00:37.316265 15254 catalog_manager.cc:4841] TS b81c54674f2b40e4888efb29a398e706 (127.13.30.131:46341): tablet 0f84388d00124157ab38ccf95d3fe609 (table test-table [id=2e17d7483ea94c869d2310996a798240]) successfully deleted
I20260811 01:00:37.316412 16175 ts_tablet_manager.cc:1905] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:37.317601 16175 ts_tablet_manager.cc:1918] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:00:37.317657 16175 log.cc:1196] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/0f84388d00124157ab38ccf95d3fe609
I20260811 01:00:37.317826 16175 ts_tablet_manager.cc:1939] T 0f84388d00124157ab38ccf95d3fe609 P 76420d0098b24b0d8cebfc124f43e9ad: Deleting consensus metadata
I20260811 01:00:37.318219 15253 catalog_manager.cc:4841] TS 76420d0098b24b0d8cebfc124f43e9ad (127.13.30.130:46255): tablet 0f84388d00124157ab38ccf95d3fe609 (table test-table [id=2e17d7483ea94c869d2310996a798240]) successfully deleted
Aug 11 01:00:37 dist-test-slave-42z9 krb5kdc[15212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410036, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.30.129@KRBTEST.COM
I20260811 01:00:37.323402 16134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.314057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52382 (local address 127.13.30.129:40607)
0811 01:00:37.314102 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:37.314104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:37.314401 (+ 297us) server_negotiation.cc:407] Connection header received
0811 01:00:37.314450 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:37.314451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:37.314463 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:37.314530 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:37.315250 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.315919 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.316806 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.317008 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.317073 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.320382 (+ 3309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:37.320396 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:37.320396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:37.320405 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:37.322202 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:37.322556 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:37.322560 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:37.322561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:37.322670 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:37.322852 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:37.322853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:37.322853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:37.323008 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:37.323176 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:37.323214 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 01:00:37.323306 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 01:00:37.323700 15605 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52382
I20260811 01:00:37.330466 15361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:37.324714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44816 (local address 127.13.30.190:42381)
0811 01:00:37.324769 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:37.324771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:37.324809 (+ 38us) server_negotiation.cc:407] Connection header received
0811 01:00:37.324876 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:37.324877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:37.324888 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:37.324934 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:37.325469 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.325972 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.326643 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:37.326844 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:37.326898 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:37.328100 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:37.328101 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:37.328102 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:37.328110 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:37.329324 (+ 1214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:37.329746 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:37.329747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:37.329747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:37.329806 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:37.329969 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:37.329970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:37.329971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:37.330098 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:37.330188 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:37.330285 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 01:00:37.330370 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 01:00:37.330713 15277 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44816
I20260811 01:00:37.331446 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 15402
I20260811 01:00:37.346709 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 15639
I20260811 01:00:37.372300 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 15870
I20260811 01:00:37.391571 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 15231
2026-08-11T01:00:37Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2485 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:37 dist-test-slave-42z9 krb5kdc[16242](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:37 dist-test-slave-42z9 krb5kdc[16242](info): set up 2 sockets
Aug 11 01:00:37 dist-test-slave-42z9 krb5kdc[16242](info): commencing operation
krb5kdc: starting...
W20260811 01:00:38.584085 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:00:38 dist-test-slave-42z9 krb5kdc[16242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:00:38.710059 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:35083
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:35083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:38.796828 16264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:38.797075 16264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:38.797101 16264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:38.798360 16264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:38.798408 16264 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 01:00:38.798420 16264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:38.798442 16264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:38.798454 16264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:38.798468 16264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:38.800139 16264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:35083
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:35083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:38.800395 16264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:38.800611 16264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:38.805617 16276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:38.805634 16280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:38.805711 16277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:38.805886 16264 server_base.cc:1034] running on GCE node
I20260811 01:00:38.806198 16264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:38.806510 16264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:38.807662 16264 hybrid_clock.cc:648] HybridClock initialized: now 1786410038807649 us; error 29 us; skew 500 ppm
Aug 11 01:00:38 dist-test-slave-42z9 krb5kdc[16242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410038, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:38.810365 16264 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:00:38.810891 16264 webserver.cc:460] Webserver started at http://127.13.30.190:34189/ using document root <none> and password file <none>
I20260811 01:00:38.811111 16264 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:38.811165 16264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:38.811305 16264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:38.812463 16264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "a66a82b014c74d6b920b9567e0115e06"
format_stamp: "Formatted at 2026-08-11 01:00:38 on dist-test-slave-42z9"
server_key: "1cb3f42e52d99fafa898d05a3af0887c"
server_key_iv: "b40acf72af3748f8248a6c28f166779d"
server_key_version: "encryptionkey@0"
I20260811 01:00:38.812829 16264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "a66a82b014c74d6b920b9567e0115e06"
format_stamp: "Formatted at 2026-08-11 01:00:38 on dist-test-slave-42z9"
server_key: "1cb3f42e52d99fafa898d05a3af0887c"
server_key_iv: "b40acf72af3748f8248a6c28f166779d"
server_key_version: "encryptionkey@0"
I20260811 01:00:38.814267 16264 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:00:38.815009 16291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:38.815171 16264 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 01:00:38.815259 16264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "a66a82b014c74d6b920b9567e0115e06"
format_stamp: "Formatted at 2026-08-11 01:00:38 on dist-test-slave-42z9"
server_key: "1cb3f42e52d99fafa898d05a3af0887c"
server_key_iv: "b40acf72af3748f8248a6c28f166779d"
server_key_version: "encryptionkey@0"
I20260811 01:00:38.815325 16264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:38.826978 16264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:38.829279 16264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:38.829471 16264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:38.834424 16264 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:35083
I20260811 01:00:38.834496 16404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:35083 every 8 connection(s)
I20260811 01:00:38.834887 16264 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:38.835600 16406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:38.835953 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 16264
I20260811 01:00:38.836050 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:38.836218 13434 external_mini_cluster.cc:1428] Setting key 3699de0478f3b58582b2fa7010daa256
I20260811 01:00:38.838517 16406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06: Bootstrap starting.
I20260811 01:00:38.839169 16406 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:38.839457 16406 log.cc:824] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:38.840179 16406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06: No bootstrap required, opened a new log
Aug 11 01:00:38 dist-test-slave-42z9 krb5kdc[16242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:38.842427 16406 raft_consensus.cc:348] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66a82b014c74d6b920b9567e0115e06" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35083 } }
I20260811 01:00:38.842582 16406 raft_consensus.cc:374] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:38.842605 16406 raft_consensus.cc:729] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a66a82b014c74d6b920b9567e0115e06, State: Initialized, Role: FOLLOWER
I20260811 01:00:38.842743 16406 consensus_queue.cc:260] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66a82b014c74d6b920b9567e0115e06" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35083 } }
I20260811 01:00:38.842831 16406 raft_consensus.cc:388] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:38.842873 16406 raft_consensus.cc:482] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:38.842929 16406 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:38.843636 16406 raft_consensus.cc:504] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66a82b014c74d6b920b9567e0115e06" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35083 } }
I20260811 01:00:38.843762 16406 leader_election.cc:302] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a66a82b014c74d6b920b9567e0115e06; no voters:
I20260811 01:00:38.843971 16406 leader_election.cc:288] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:38.844024 16416 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:38.844321 16406 sys_catalog.cc:564] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:38.844386 16416 raft_consensus.cc:686] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [term 1 LEADER]: Becoming Leader. State: Replica: a66a82b014c74d6b920b9567e0115e06, State: Running, Role: LEADER
I20260811 01:00:38.844498 16416 consensus_queue.cc:237] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66a82b014c74d6b920b9567e0115e06" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35083 } }
I20260811 01:00:38.844837 16416 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a66a82b014c74d6b920b9567e0115e06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66a82b014c74d6b920b9567e0115e06" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35083 } } }
I20260811 01:00:38.844921 16416 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:38.845047 16416 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a66a82b014c74d6b920b9567e0115e06. Latest consensus state: current_term: 1 leader_uuid: "a66a82b014c74d6b920b9567e0115e06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66a82b014c74d6b920b9567e0115e06" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35083 } } }
I20260811 01:00:38.845105 16416 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:38.845229 16430 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:38.846089 16430 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:38.847394 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:38.836766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50760 (local address 127.13.30.190:35083)
0811 01:00:38.836955 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:38.836963 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:38.836990 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:00:38.837434 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:38.837466 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:38.837533 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:38.837665 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:38.838283 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:38.839217 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:38.840018 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:38.840632 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:38.840754 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:38.843197 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:38.843202 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:38.843203 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:38.843216 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:38.845218 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:38.845717 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:38.845721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:38.845721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:38.845837 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:38.846403 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:38.846404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:38.846404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:38.846729 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:38.846922 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:38.847036 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 01:00:38.847192 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":94,"threads_started":1}
I20260811 01:00:38.848064 16430 catalog_manager.cc:1347] Generated new cluster ID: 158dd84218a04bbeba7e1c87a67344f7
I20260811 01:00:38.848109 16430 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:38.868398 16430 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:38.869002 16430 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:38.870914 16430 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06: Generated new TSK 0
I20260811 01:00:38.871138 16430 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:00:38.900274 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35083
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:38.987857 16450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:38.988111 16450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:38.988142 16450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:38.989465 16450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:38.989521 16450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:38.989545 16450 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 01:00:38.989566 16450 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:00:38.989599 16450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:00:38.991336 16450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.30.190:35083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:38.991606 16450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:38.991861 16450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:38.996961 16456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:38.997074 16455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:38.997184 16450 server_base.cc:1034] running on GCE node
W20260811 01:00:38.997074 16459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:38.997480 16450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:38.997753 16450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:38.998901 16450 hybrid_clock.cc:648] HybridClock initialized: now 1786410038998889 us; error 32 us; skew 500 ppm
Aug 11 01:00:38 dist-test-slave-42z9 krb5kdc[16242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410038, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:39.001557 16450 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:00:39.002139 16450 webserver.cc:460] Webserver started at http://127.13.30.129:36955/ using document root <none> and password file <none>
I20260811 01:00:39.002381 16450 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:39.002426 16450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:39.002537 16450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:39.003607 16450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "7552bec4fd0e4808a663d72a8c21ca33"
format_stamp: "Formatted at 2026-08-11 01:00:38 on dist-test-slave-42z9"
server_key: "a9d235c83b0cbd2011d70853f67fb627"
server_key_iv: "b0e04fac2b17232e0bef0e4d61dcb934"
server_key_version: "encryptionkey@0"
I20260811 01:00:39.003919 16450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "7552bec4fd0e4808a663d72a8c21ca33"
format_stamp: "Formatted at 2026-08-11 01:00:38 on dist-test-slave-42z9"
server_key: "a9d235c83b0cbd2011d70853f67fb627"
server_key_iv: "b0e04fac2b17232e0bef0e4d61dcb934"
server_key_version: "encryptionkey@0"
I20260811 01:00:39.005309 16450 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:39.006104 16477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:39.006280 16450 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 01:00:39.006361 16450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "7552bec4fd0e4808a663d72a8c21ca33"
format_stamp: "Formatted at 2026-08-11 01:00:38 on dist-test-slave-42z9"
server_key: "a9d235c83b0cbd2011d70853f67fb627"
server_key_iv: "b0e04fac2b17232e0bef0e4d61dcb934"
server_key_version: "encryptionkey@0"
I20260811 01:00:39.006433 16450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:39.027521 16450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:39.029557 16450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:39.029716 16450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:39.030285 16450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:39.030333 16450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:39.030377 16450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:39.030400 16450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:00:39 dist-test-slave-42z9 krb5kdc[16242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410038, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:39.038151 16450 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:46695
I20260811 01:00:39.038192 16668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:46695 every 8 connection(s)
I20260811 01:00:39.038633 16450 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:00:39.041383 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.031052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:41003 (local address 127.13.30.190:35083)
0811 01:00:39.031147 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.031149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.031419 (+ 270us) server_negotiation.cc:407] Connection header received
0811 01:00:39.032391 (+ 972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.032393 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.032412 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.032508 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:39.033585 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.034284 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.035514 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.035800 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.035867 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.038408 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:39.038410 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:39.038410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:39.038419 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:39.039948 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.040392 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.040394 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.040394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.040457 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.040681 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.040683 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.040683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.040810 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:39.040868 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.041160 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.041282 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 01:00:39.041592 16492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.030904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35083 (local address 127.13.30.129:41003)
0811 01:00:39.031214 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:39.031284 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:39.032220 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:39.032614 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:39.032621 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:39.033063 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:39.033473 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.033480 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.034460 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.034463 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.035398 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.035403 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.035904 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.035905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.036050 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.036616 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:39.036629 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:39.038270 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:39.040058 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:39.040066 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:39.040069 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:39.040313 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:39.040514 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:39.040515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:39.040515 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:39.040625 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:39.040866 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:39.040874 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:39.041029 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 01:00:39.041127 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 01:00:39.041316 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":116,"threads_started":1}
I20260811 01:00:39.042101 16669 heartbeater.cc:347] Connected to a master server at 127.13.30.190:35083
I20260811 01:00:39.042207 16669 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:39.042450 16669 heartbeater.cc:511] Master 127.13.30.190:35083 requested a full tablet report, sending...
I20260811 01:00:39.043038 16325 ts_manager.cc:194] Registered new tserver with Master: 7552bec4fd0e4808a663d72a8c21ca33 (127.13.30.129:46695)
I20260811 01:00:39.043792 16325 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:41003
I20260811 01:00:39.046614 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 16450
I20260811 01:00:39.046702 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:00:39.046871 13434 external_mini_cluster.cc:1428] Setting key 83f81fe21126970a3bfd2279dc559c0d
I20260811 01:00:39.049268 16682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.043221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35083 (local address 127.13.30.129:52539)
0811 01:00:39.043376 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:39.043387 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:39.043450 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:39.043566 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:39.043567 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:39.043757 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:39.043815 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.043817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.044781 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.044782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.045362 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.045365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.045759 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.045760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.045848 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.046341 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:39.046347 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:39.046684 (+ 337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:39.048372 (+ 1688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:39.048373 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:39.048373 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:39.048554 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:39.048739 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:39.048740 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:39.048740 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:39.048788 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:39.049015 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:39.049015 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:39.049057 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 01:00:39.049100 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 01:00:39.049191 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":89,"threads_started":1}
I20260811 01:00:39.049305 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.043278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:52539 (local address 127.13.30.190:35083)
0811 01:00:39.043317 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.043319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.043446 (+ 127us) server_negotiation.cc:407] Connection header received
0811 01:00:39.043505 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.043506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.043517 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.043563 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:39.043918 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.044695 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.045434 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.045693 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.045754 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.046785 (+ 1031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:39.046787 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:39.046787 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:39.046795 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:39.048277 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.048615 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.048616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.048616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.048682 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.048832 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.048833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.048833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.048958 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:39.049027 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.049125 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.049212 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:00:39.072604 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35083
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:39.161332 16696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:39.161628 16696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:39.161661 16696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:39.162954 16696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:39.162994 16696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:39.163014 16696 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 01:00:39.163030 16696 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:00:39.163048 16696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:00:39.164649 16696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.30.190:35083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:39.164877 16696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:39.165081 16696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:39.170433 16707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:39.170428 16706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:39.170430 16709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:39.170454 16696 server_base.cc:1034] running on GCE node
I20260811 01:00:39.170876 16696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:39.171155 16696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:39.172315 16696 hybrid_clock.cc:648] HybridClock initialized: now 1786410039172298 us; error 43 us; skew 500 ppm
Aug 11 01:00:39 dist-test-slave-42z9 krb5kdc[16242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410039, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:39.175091 16696 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:00:39.175645 16696 webserver.cc:460] Webserver started at http://127.13.30.130:37011/ using document root <none> and password file <none>
I20260811 01:00:39.175894 16696 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:39.175948 16696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:39.176088 16696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:39.177205 16696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "4fd578efea8448f4ba06b7ab77acbd47"
format_stamp: "Formatted at 2026-08-11 01:00:39 on dist-test-slave-42z9"
server_key: "735d27077adff2381c68c06236cce590"
server_key_iv: "254ce974bfe644981f4e1e5670a74b69"
server_key_version: "encryptionkey@0"
I20260811 01:00:39.177590 16696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "4fd578efea8448f4ba06b7ab77acbd47"
format_stamp: "Formatted at 2026-08-11 01:00:39 on dist-test-slave-42z9"
server_key: "735d27077adff2381c68c06236cce590"
server_key_iv: "254ce974bfe644981f4e1e5670a74b69"
server_key_version: "encryptionkey@0"
I20260811 01:00:39.179103 16696 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:39.179893 16719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:39.180116 16696 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:39.180212 16696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "4fd578efea8448f4ba06b7ab77acbd47"
format_stamp: "Formatted at 2026-08-11 01:00:39 on dist-test-slave-42z9"
server_key: "735d27077adff2381c68c06236cce590"
server_key_iv: "254ce974bfe644981f4e1e5670a74b69"
server_key_version: "encryptionkey@0"
I20260811 01:00:39.180282 16696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:39.201572 16696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:39.203619 16696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:39.203775 16696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:39.204419 16696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:39.204468 16696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:39.204499 16696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:39.204516 16696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:00:39 dist-test-slave-42z9 krb5kdc[16242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410039, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:39.212510 16696 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:43463
I20260811 01:00:39.212777 16929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:43463 every 8 connection(s)
I20260811 01:00:39.212924 16696 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:00:39.215860 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.204820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:54195 (local address 127.13.30.190:35083)
0811 01:00:39.204889 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.204891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.205140 (+ 249us) server_negotiation.cc:407] Connection header received
0811 01:00:39.205892 (+ 752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.205893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.205905 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.205954 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:39.206916 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.207511 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.209032 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.209332 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.209414 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.212676 (+ 3262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:39.212679 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:39.212679 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:39.212693 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:39.214354 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.214915 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.214917 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.214918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.215021 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.215243 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.215244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.215244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.215395 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:39.215452 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.215694 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.215786 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 01:00:39.216001 16738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.204806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35083 (local address 127.13.30.130:54195)
0811 01:00:39.204989 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:39.205041 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:39.205780 (+ 739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:39.206053 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:39.206058 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:39.206449 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:39.206796 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.206803 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.207595 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.207597 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.208945 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.208949 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.209466 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.209468 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.209658 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.210325 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:39.210336 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:39.212443 (+ 2107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:39.214467 (+ 2024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:39.214475 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:39.214477 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:39.214774 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:39.215094 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:39.215095 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:39.215096 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:39.215196 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:39.215442 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:39.215445 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:39.215583 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 01:00:39.215669 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 01:00:39.215813 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
I20260811 01:00:39.216543 16930 heartbeater.cc:347] Connected to a master server at 127.13.30.190:35083
I20260811 01:00:39.216635 16930 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:39.216826 16930 heartbeater.cc:511] Master 127.13.30.190:35083 requested a full tablet report, sending...
I20260811 01:00:39.217330 16325 ts_manager.cc:194] Registered new tserver with Master: 4fd578efea8448f4ba06b7ab77acbd47 (127.13.30.130:43463)
I20260811 01:00:39.217921 16325 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:54195
I20260811 01:00:39.219372 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 16696
I20260811 01:00:39.219449 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:00:39.219619 13434 external_mini_cluster.cc:1428] Setting key 59770d2d50f5d8123642ea481ce6cfba
I20260811 01:00:39.224290 16938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.218025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35083 (local address 127.13.30.130:53227)
0811 01:00:39.218325 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:39.218334 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:39.218392 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:39.218518 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:39.218519 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:39.218712 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:39.218767 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.218769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.219618 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.219619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.220348 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.220351 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.220689 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.220690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.220765 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.221221 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:39.221226 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:39.221590 (+ 364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:39.223232 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:39.223233 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:39.223234 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:39.223429 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:39.223629 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:39.223630 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:39.223630 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:39.223692 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:39.223955 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:39.223956 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:39.224007 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 01:00:39.224068 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 01:00:39.224185 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":77,"threads_started":1}
I20260811 01:00:39.224288 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.218076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:53227 (local address 127.13.30.190:35083)
0811 01:00:39.218277 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.218279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.218397 (+ 118us) server_negotiation.cc:407] Connection header received
0811 01:00:39.218449 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.218450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.218467 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.218514 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:39.218837 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.219423 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.220420 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.220629 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.220684 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.221675 (+ 991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:39.221677 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:39.221677 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:39.221684 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:39.223145 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.223510 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.223512 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.223512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.223572 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.223743 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.223744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.223744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.223893 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:39.223955 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.224099 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.224190 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179}
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:00:39.246143 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35083
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:39.335768 16942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:39.336027 16942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:39.336058 16942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:39.337355 16942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:39.337417 16942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:39.337471 16942 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 01:00:39.337489 16942 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:00:39.337514 16942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:00:39.339246 16942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.30.190:35083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:39.339541 16942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:39.339797 16942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:39.345109 16953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:39.345109 16947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:39.345130 16948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:39.345520 16942 server_base.cc:1034] running on GCE node
I20260811 01:00:39.345698 16942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:39.345980 16942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:39.347123 16942 hybrid_clock.cc:648] HybridClock initialized: now 1786410039347114 us; error 28 us; skew 500 ppm
Aug 11 01:00:39 dist-test-slave-42z9 krb5kdc[16242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410039, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:39.349736 16942 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:00:39.350310 16942 webserver.cc:460] Webserver started at http://127.13.30.131:39551/ using document root <none> and password file <none>
I20260811 01:00:39.350517 16942 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:39.350556 16942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:39.350654 16942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:39.351740 16942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "0a331645cf1a404ea7b4f861c7fbcd76"
format_stamp: "Formatted at 2026-08-11 01:00:39 on dist-test-slave-42z9"
server_key: "b9d26eaf8e0c2d98b9e0edd5db66e325"
server_key_iv: "18bdeeec1b8ab69ff0ef50162b5c5755"
server_key_version: "encryptionkey@0"
I20260811 01:00:39.352059 16942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "0a331645cf1a404ea7b4f861c7fbcd76"
format_stamp: "Formatted at 2026-08-11 01:00:39 on dist-test-slave-42z9"
server_key: "b9d26eaf8e0c2d98b9e0edd5db66e325"
server_key_iv: "18bdeeec1b8ab69ff0ef50162b5c5755"
server_key_version: "encryptionkey@0"
I20260811 01:00:39.353363 16942 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:39.354166 16966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:39.354394 16942 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:39.354488 16942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "0a331645cf1a404ea7b4f861c7fbcd76"
format_stamp: "Formatted at 2026-08-11 01:00:39 on dist-test-slave-42z9"
server_key: "b9d26eaf8e0c2d98b9e0edd5db66e325"
server_key_iv: "18bdeeec1b8ab69ff0ef50162b5c5755"
server_key_version: "encryptionkey@0"
I20260811 01:00:39.354557 16942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:39.366289 16942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:39.368893 16942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:39.369022 16942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:39.369721 16942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:39.369766 16942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:39.369789 16942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:39.369801 16942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:00:39 dist-test-slave-42z9 krb5kdc[16242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410039, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:39.377177 16942 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:43789
I20260811 01:00:39.377410 17167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:43789 every 8 connection(s)
I20260811 01:00:39.377653 16942 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:00:39.381229 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.370153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:54815 (local address 127.13.30.190:35083)
0811 01:00:39.370203 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.370205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.370440 (+ 235us) server_negotiation.cc:407] Connection header received
0811 01:00:39.371119 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.371120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.371135 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.371195 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:39.372182 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.372963 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.374563 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.374867 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.374939 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.378224 (+ 3285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:39.378227 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:39.378227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:39.378237 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:39.379983 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.380409 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.380411 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.380411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.380490 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.380697 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.380697 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.380698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.380814 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:39.380861 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.381085 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.381159 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 01:00:39.381390 16980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.370154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35083 (local address 127.13.30.131:54815)
0811 01:00:39.370320 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:39.370363 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:39.370896 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:39.371306 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:39.371311 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:39.371730 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:39.372067 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.372075 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.373069 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.373070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.374453 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.374458 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.374986 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.374987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.375145 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.375706 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:39.375717 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:39.378096 (+ 2379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:39.380067 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:39.380074 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:39.380077 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:39.380309 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:39.380550 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:39.380551 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:39.380551 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:39.380651 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:39.380861 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:39.380864 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:39.380987 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 01:00:39.381066 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 01:00:39.381201 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":94,"threads_started":1}
I20260811 01:00:39.381896 17168 heartbeater.cc:347] Connected to a master server at 127.13.30.190:35083
I20260811 01:00:39.381982 17168 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:39.382169 17168 heartbeater.cc:511] Master 127.13.30.190:35083 requested a full tablet report, sending...
I20260811 01:00:39.382531 16325 ts_manager.cc:194] Registered new tserver with Master: 0a331645cf1a404ea7b4f861c7fbcd76 (127.13.30.131:43789)
I20260811 01:00:39.382965 16325 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:54815
I20260811 01:00:39.383402 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 16942
I20260811 01:00:39.383488 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:00:39.383679 13434 external_mini_cluster.cc:1428] Setting key 93f84485a42607b293cac7fff14cc90f
I20260811 01:00:39.384533 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:00:39.389530 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.383011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:51101 (local address 127.13.30.190:35083)
0811 01:00:39.383051 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.383053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.383210 (+ 157us) server_negotiation.cc:407] Connection header received
0811 01:00:39.383268 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.383269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.383280 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.383333 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:39.383701 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.384367 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.385114 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.385381 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.385471 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.386577 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:39.386580 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:39.386580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:39.386606 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:39.388331 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.388718 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.388719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.388720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.388789 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.388962 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.388963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.388963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.389084 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:39.389146 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.389287 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.389383 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 01:00:39.389541 17177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.382953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35083 (local address 127.13.30.131:51101)
0811 01:00:39.383151 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:39.383162 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:39.383218 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:39.383351 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:39.383352 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:39.383566 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:39.383634 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.383637 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.384478 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.384479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.385037 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.385039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.385486 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.385487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.385554 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.386024 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:39.386030 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:39.386360 (+ 330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:39.388452 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:39.388454 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:39.388454 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:39.388642 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:39.388846 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:39.388847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:39.388847 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:39.388911 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:39.389141 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:39.389142 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:39.389194 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 01:00:39.389256 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 01:00:39.389385 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":80,"threads_started":1}
Aug 11 01:00:39 dist-test-slave-42z9 krb5kdc[16242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410039, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:00:39 dist-test-slave-42z9 krb5kdc[16242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410039, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:39.410310 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.403447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50772 (local address 127.13.30.190:35083)
0811 01:00:39.403506 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.403508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.403517 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:00:39.403545 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.403545 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.403555 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.403603 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:39.404193 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.404701 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.405425 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.405646 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.405705 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.407901 (+ 2196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:39.407903 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:39.407903 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:39.407911 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:39.409166 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.409550 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.409551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.409552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.409609 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.409799 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.409800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.409800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.409919 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:39.410010 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.410123 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.410210 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 01:00:39.411881 16325 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50772:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:00:39.413607 16325 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:00:39.420755 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.416234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:46695 (local address 127.0.0.1:33002)
0811 01:00:39.416398 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:39.416444 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:39.416515 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:39.417165 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:39.417166 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:39.417168 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:39.417232 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.417234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.418629 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.418630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.419717 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.419720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.420415 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.420416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.420507 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.420523 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 01:00:39.420601 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 01:00:39.420661 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":70,"threads_started":1}
I20260811 01:00:39.420806 17202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.416792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33002 (local address 127.13.30.129:46695)
0811 01:00:39.416984 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.416988 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.417001 (+ 13us) server_negotiation.cc:407] Connection header received
0811 01:00:39.417042 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.417044 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.417060 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.417304 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:39.417360 (+ 56us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.418527 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.419800 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.420334 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.420405 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.420451 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.420639 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.420687 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":85,"threads_started":1}
I20260811 01:00:39.421519 17200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.416404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52340 (local address 127.13.30.130:43463)
0811 01:00:39.416760 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.416765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.416776 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:00:39.416816 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.416818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.416834 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.416905 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:39.417109 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.418249 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.420488 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.421134 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.421212 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.421270 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.421352 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.421400 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":270,"threads_started":1}
I20260811 01:00:39.421551 17199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.416234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:43463 (local address 127.0.0.1:52340)
0811 01:00:39.416569 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:39.416577 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:39.416614 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:39.416927 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:39.416930 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:39.416932 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:39.417031 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.417033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.418331 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.418332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.419717 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.419720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.421212 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.421213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.421276 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.421279 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:00:39.421337 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 01:00:39.421381 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"mutex_wait_us":37,"thread_start_us":104,"threads_started":1}
I20260811 01:00:39.421962 16563 tablet_service.cc:1467] Processing CreateTablet for tablet 3faafee81acb45ab9bcb32b20f0e7a4a (DEFAULT_TABLE table=test-table [id=63a941350f394876a77f2190779f3477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:39.422402 16563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3faafee81acb45ab9bcb32b20f0e7a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:39.422307 16812 tablet_service.cc:1467] Processing CreateTablet for tablet 3faafee81acb45ab9bcb32b20f0e7a4a (DEFAULT_TABLE table=test-table [id=63a941350f394876a77f2190779f3477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:39.422516 17193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.416451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:43789 (local address 127.0.0.1:55016)
0811 01:00:39.417110 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:39.417120 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:39.417166 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:39.417361 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:39.417362 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:39.417364 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:39.417412 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.417413 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.419821 (+ 2408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.419822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.420608 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.420610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.422261 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.422262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.422328 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.422332 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:00:39.422385 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 01:00:39.422430 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":68,"threads_started":1}
I20260811 01:00:39.422637 16812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3faafee81acb45ab9bcb32b20f0e7a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:39.422789 17201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.416566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55016 (local address 127.13.30.131:43789)
0811 01:00:39.416760 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.416765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.417223 (+ 458us) server_negotiation.cc:407] Connection header received
0811 01:00:39.417270 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.417272 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.417287 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.417359 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:39.417583 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.418699 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.420698 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.422111 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.422251 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.422325 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.422402 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.422442 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":92,"threads_started":1}
I20260811 01:00:39.423321 17028 tablet_service.cc:1467] Processing CreateTablet for tablet 3faafee81acb45ab9bcb32b20f0e7a4a (DEFAULT_TABLE table=test-table [id=63a941350f394876a77f2190779f3477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:39.423635 17028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3faafee81acb45ab9bcb32b20f0e7a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:39.426240 17204 tablet_bootstrap.cc:492] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76: Bootstrap starting.
I20260811 01:00:39.426838 17205 tablet_bootstrap.cc:492] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47: Bootstrap starting.
I20260811 01:00:39.427407 17204 tablet_bootstrap.cc:654] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:39.427484 17205 tablet_bootstrap.cc:654] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:39.427788 17204 log.cc:824] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:39.427793 17205 log.cc:824] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:39.428249 17206 tablet_bootstrap.cc:492] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33: Bootstrap starting.
I20260811 01:00:39.428732 17204 tablet_bootstrap.cc:492] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76: No bootstrap required, opened a new log
I20260811 01:00:39.428733 17205 tablet_bootstrap.cc:492] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47: No bootstrap required, opened a new log
I20260811 01:00:39.428807 17205 ts_tablet_manager.cc:1397] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:00:39.428807 17204 ts_tablet_manager.cc:1397] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 01:00:39.428937 17206 tablet_bootstrap.cc:654] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:39.429291 17206 log.cc:824] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:39.430155 17206 tablet_bootstrap.cc:492] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33: No bootstrap required, opened a new log
I20260811 01:00:39.430239 17206 ts_tablet_manager.cc:1397] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:00:39.430603 17204 raft_consensus.cc:348] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.430745 17204 raft_consensus.cc:374] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:39.430778 17204 raft_consensus.cc:729] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a331645cf1a404ea7b4f861c7fbcd76, State: Initialized, Role: FOLLOWER
I20260811 01:00:39.430902 17204 consensus_queue.cc:260] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.430843 17205 raft_consensus.cc:348] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.431051 17205 raft_consensus.cc:374] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:39.431085 17205 raft_consensus.cc:729] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fd578efea8448f4ba06b7ab77acbd47, State: Initialized, Role: FOLLOWER
I20260811 01:00:39.431203 17205 consensus_queue.cc:260] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.431313 17204 ts_tablet_manager.cc:1428] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 01:00:39.431455 17168 heartbeater.cc:503] Master 127.13.30.190:35083 was elected leader, sending a full tablet report...
I20260811 01:00:39.431475 17205 ts_tablet_manager.cc:1428] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:00:39.431586 16930 heartbeater.cc:503] Master 127.13.30.190:35083 was elected leader, sending a full tablet report...
I20260811 01:00:39.432286 17206 raft_consensus.cc:348] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.432444 17206 raft_consensus.cc:374] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:39.432482 17206 raft_consensus.cc:729] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7552bec4fd0e4808a663d72a8c21ca33, State: Initialized, Role: FOLLOWER
I20260811 01:00:39.432583 17206 consensus_queue.cc:260] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.432847 17206 ts_tablet_manager.cc:1428] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:00:39.432973 16669 heartbeater.cc:503] Master 127.13.30.190:35083 was elected leader, sending a full tablet report...
W20260811 01:00:39.463783 16931 tablet.cc:2369] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:00:39.539913 16673 tablet.cc:2369] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:00:39.620148 17212 raft_consensus.cc:482] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:00:39.620291 17212 raft_consensus.cc:504] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.620641 17212 leader_election.cc:288] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7552bec4fd0e4808a663d72a8c21ca33 (127.13.30.129:46695), 0a331645cf1a404ea7b4f861c7fbcd76 (127.13.30.131:43789)
I20260811 01:00:39.623544 17202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.620907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:46785 (local address 127.13.30.129:46695)
0811 01:00:39.620956 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.620958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.621142 (+ 184us) server_negotiation.cc:407] Connection header received
0811 01:00:39.621198 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.621199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.621208 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.621259 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:39.621411 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.621919 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.622842 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.623206 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.623272 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.623282 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.623431 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.623476 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 01:00:39.623584 17214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.620868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:46695 (local address 127.13.30.130:46785)
0811 01:00:39.621072 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:39.621081 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:39.621144 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:39.621266 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:39.621267 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:39.621280 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:39.621354 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.621356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.621998 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.621999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.622742 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.622744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.623283 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.623284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.623362 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.623365 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:00:39.623412 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 01:00:39.623453 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":35,"thread_start_us":106,"threads_started":1}
I20260811 01:00:39.623589 17201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.620932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:34971 (local address 127.13.30.131:43789)
0811 01:00:39.620990 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.620992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.621002 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:00:39.621075 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.621076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.621086 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.621128 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:39.621271 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.621818 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.622817 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.623249 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.623312 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.623321 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.623473 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.623518 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 01:00:39.623592 16738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.620860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:43789 (local address 127.13.30.130:34971)
0811 01:00:39.620934 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:39.620947 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:39.621007 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:39.621143 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:39.621144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:39.621146 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:39.621216 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.621217 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.621902 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.621903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.622720 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.622722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.623324 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.623325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.623413 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.623416 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:00:39.623462 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:00:39.623512 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 01:00:39.624002 16589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3faafee81acb45ab9bcb32b20f0e7a4a" candidate_uuid: "4fd578efea8448f4ba06b7ab77acbd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7552bec4fd0e4808a663d72a8c21ca33" is_pre_election: true
I20260811 01:00:39.624177 16589 raft_consensus.cc:2454] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fd578efea8448f4ba06b7ab77acbd47 in term 0.
I20260811 01:00:39.624135 17083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3faafee81acb45ab9bcb32b20f0e7a4a" candidate_uuid: "4fd578efea8448f4ba06b7ab77acbd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" is_pre_election: true
I20260811 01:00:39.624279 17083 raft_consensus.cc:2454] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fd578efea8448f4ba06b7ab77acbd47 in term 0.
I20260811 01:00:39.624413 16721 leader_election.cc:302] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fd578efea8448f4ba06b7ab77acbd47, 7552bec4fd0e4808a663d72a8c21ca33; no voters:
I20260811 01:00:39.624528 17212 raft_consensus.cc:2781] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:00:39.624586 17212 raft_consensus.cc:482] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:00:39.624601 17212 raft_consensus.cc:3037] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:39.625639 17212 raft_consensus.cc:504] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.625785 17212 leader_election.cc:288] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [CANDIDATE]: Term 1 election: Requested vote from peers 7552bec4fd0e4808a663d72a8c21ca33 (127.13.30.129:46695), 0a331645cf1a404ea7b4f861c7fbcd76 (127.13.30.131:43789)
I20260811 01:00:39.625941 17083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3faafee81acb45ab9bcb32b20f0e7a4a" candidate_uuid: "4fd578efea8448f4ba06b7ab77acbd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a331645cf1a404ea7b4f861c7fbcd76"
I20260811 01:00:39.626020 17083 raft_consensus.cc:3037] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:39.626801 17083 raft_consensus.cc:2454] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fd578efea8448f4ba06b7ab77acbd47 in term 1.
I20260811 01:00:39.626929 16589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3faafee81acb45ab9bcb32b20f0e7a4a" candidate_uuid: "4fd578efea8448f4ba06b7ab77acbd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7552bec4fd0e4808a663d72a8c21ca33"
I20260811 01:00:39.627008 16722 leader_election.cc:302] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a331645cf1a404ea7b4f861c7fbcd76, 4fd578efea8448f4ba06b7ab77acbd47; no voters:
I20260811 01:00:39.627012 16589 raft_consensus.cc:3037] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:39.627122 17212 raft_consensus.cc:2781] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:39.627290 17212 raft_consensus.cc:686] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 LEADER]: Becoming Leader. State: Replica: 4fd578efea8448f4ba06b7ab77acbd47, State: Running, Role: LEADER
I20260811 01:00:39.627403 17212 consensus_queue.cc:237] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.627923 16589 raft_consensus.cc:2454] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fd578efea8448f4ba06b7ab77acbd47 in term 1.
I20260811 01:00:39.628325 16325 catalog_manager.cc:5495] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fd578efea8448f4ba06b7ab77acbd47 (127.13.30.130). New cstate: current_term: 1 leader_uuid: "4fd578efea8448f4ba06b7ab77acbd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } health_report { overall_health: UNKNOWN } } }
W20260811 01:00:39.628783 17169 tablet.cc:2369] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 01:00:39 dist-test-slave-42z9 krb5kdc[16242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410038, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:39.672861 17227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.666216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35083 (local address 127.0.0.1:38238)
0811 01:00:39.666369 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:39.666379 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:39.666549 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:39.666671 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:39.666671 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:39.667016 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:39.667076 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.667079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.667696 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.667696 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.668232 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.668233 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.668514 (+ 281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.668515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.668554 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.669026 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:39.669030 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:39.670397 (+ 1367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:39.671797 (+ 1400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:39.671803 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:39.671805 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:39.671990 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:39.672127 (+ 137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:39.672127 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:39.672128 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:39.672182 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:39.672525 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:39.672534 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:39.672587 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 01:00:39.672657 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 01:00:39.672766 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":69,"threads_started":1}
I20260811 01:00:39.672914 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.666288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38238 (local address 127.13.30.190:35083)
0811 01:00:39.666369 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.666371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.666539 (+ 168us) server_negotiation.cc:407] Connection header received
0811 01:00:39.666596 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.666597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.666606 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.666655 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:39.667137 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.667640 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.668290 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.668463 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.668514 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.670485 (+ 1971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:39.670493 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:39.670493 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:39.670500 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:39.671732 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.672040 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.672041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.672041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.672085 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:39.672265 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:39.672266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:39.672266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:39.672416 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:39.672492 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.672717 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.672824 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":55}
I20260811 01:00:39.674984 16325 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:38238:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 01:00:39.675201 16325 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:00:39.676677 17028 tablet_service.cc:1467] Processing CreateTablet for tablet 4103fb2f74894888872583da11a6a5c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=892242c54e694a4094ecde33a4e47363]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:00:39.676668 16563 tablet_service.cc:1467] Processing CreateTablet for tablet 4103fb2f74894888872583da11a6a5c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=892242c54e694a4094ecde33a4e47363]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:00:39.676676 16812 tablet_service.cc:1467] Processing CreateTablet for tablet 4103fb2f74894888872583da11a6a5c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=892242c54e694a4094ecde33a4e47363]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:00:39.676864 16563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4103fb2f74894888872583da11a6a5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:39.676865 17028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4103fb2f74894888872583da11a6a5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:39.676874 16812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4103fb2f74894888872583da11a6a5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:39.678212 17204 tablet_bootstrap.cc:492] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76: Bootstrap starting.
I20260811 01:00:39.678402 17205 tablet_bootstrap.cc:492] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47: Bootstrap starting.
I20260811 01:00:39.678427 17206 tablet_bootstrap.cc:492] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33: Bootstrap starting.
I20260811 01:00:39.678789 17206 tablet_bootstrap.cc:654] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:39.678833 17205 tablet_bootstrap.cc:654] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:39.678833 17204 tablet_bootstrap.cc:654] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:39.679464 17206 tablet_bootstrap.cc:492] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33: No bootstrap required, opened a new log
I20260811 01:00:39.679523 17206 ts_tablet_manager.cc:1397] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:39.679678 17206 raft_consensus.cc:348] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.679760 17206 raft_consensus.cc:374] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:39.679781 17206 raft_consensus.cc:729] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7552bec4fd0e4808a663d72a8c21ca33, State: Initialized, Role: FOLLOWER
I20260811 01:00:39.679838 17206 consensus_queue.cc:260] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.679898 17205 tablet_bootstrap.cc:492] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47: No bootstrap required, opened a new log
I20260811 01:00:39.679909 17204 tablet_bootstrap.cc:492] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76: No bootstrap required, opened a new log
I20260811 01:00:39.679937 17206 ts_tablet_manager.cc:1428] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:39.679957 17204 ts_tablet_manager.cc:1397] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 01:00:39.679956 17205 ts_tablet_manager.cc:1397] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:00:39.680114 17204 raft_consensus.cc:348] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.680114 17205 raft_consensus.cc:348] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.680141 17213 tablet_replica.cc:439] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } } }
I20260811 01:00:39.680189 17204 raft_consensus.cc:374] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:39.680189 17205 raft_consensus.cc:374] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:39.680212 17204 raft_consensus.cc:729] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a331645cf1a404ea7b4f861c7fbcd76, State: Initialized, Role: FOLLOWER
I20260811 01:00:39.680212 17205 raft_consensus.cc:729] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fd578efea8448f4ba06b7ab77acbd47, State: Initialized, Role: FOLLOWER
I20260811 01:00:39.680207 17213 tablet_replica.cc:442] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:00:39.680254 17205 consensus_queue.cc:260] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.680256 17204 consensus_queue.cc:260] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.680338 17204 ts_tablet_manager.cc:1428] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:39.680353 17205 ts_tablet_manager.cc:1428] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:39.680480 17212 tablet_replica.cc:439] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } } }
I20260811 01:00:39.680485 17211 tablet_replica.cc:439] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } } }
I20260811 01:00:39.680550 17212 tablet_replica.cc:442] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:00:39.680574 17211 tablet_replica.cc:442] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:00:39.771852 17212 raft_consensus.cc:482] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:00:39.771977 17212 raft_consensus.cc:504] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.772127 17212 leader_election.cc:288] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7552bec4fd0e4808a663d72a8c21ca33 (127.13.30.129:46695), 0a331645cf1a404ea7b4f861c7fbcd76 (127.13.30.131:43789)
I20260811 01:00:39.772363 16589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4103fb2f74894888872583da11a6a5c1" candidate_uuid: "4fd578efea8448f4ba06b7ab77acbd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7552bec4fd0e4808a663d72a8c21ca33" is_pre_election: true
I20260811 01:00:39.772387 17083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4103fb2f74894888872583da11a6a5c1" candidate_uuid: "4fd578efea8448f4ba06b7ab77acbd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" is_pre_election: true
I20260811 01:00:39.772478 17083 raft_consensus.cc:2454] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fd578efea8448f4ba06b7ab77acbd47 in term 0.
I20260811 01:00:39.772478 16589 raft_consensus.cc:2454] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fd578efea8448f4ba06b7ab77acbd47 in term 0.
I20260811 01:00:39.772626 16721 leader_election.cc:302] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fd578efea8448f4ba06b7ab77acbd47, 7552bec4fd0e4808a663d72a8c21ca33; no voters:
I20260811 01:00:39.772750 17212 raft_consensus.cc:2781] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:00:39.772799 17212 raft_consensus.cc:482] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:00:39.772825 17212 raft_consensus.cc:3037] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:39.773641 17212 raft_consensus.cc:504] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.773774 17212 leader_election.cc:288] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [CANDIDATE]: Term 1 election: Requested vote from peers 7552bec4fd0e4808a663d72a8c21ca33 (127.13.30.129:46695), 0a331645cf1a404ea7b4f861c7fbcd76 (127.13.30.131:43789)
I20260811 01:00:39.773950 16589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4103fb2f74894888872583da11a6a5c1" candidate_uuid: "4fd578efea8448f4ba06b7ab77acbd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7552bec4fd0e4808a663d72a8c21ca33"
I20260811 01:00:39.773980 17083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4103fb2f74894888872583da11a6a5c1" candidate_uuid: "4fd578efea8448f4ba06b7ab77acbd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a331645cf1a404ea7b4f861c7fbcd76"
I20260811 01:00:39.774037 16589 raft_consensus.cc:3037] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:39.774046 17083 raft_consensus.cc:3037] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:39.774788 17083 raft_consensus.cc:2454] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fd578efea8448f4ba06b7ab77acbd47 in term 1.
I20260811 01:00:39.774788 16589 raft_consensus.cc:2454] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fd578efea8448f4ba06b7ab77acbd47 in term 1.
I20260811 01:00:39.774946 16722 leader_election.cc:302] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a331645cf1a404ea7b4f861c7fbcd76, 4fd578efea8448f4ba06b7ab77acbd47; no voters:
I20260811 01:00:39.775055 17212 raft_consensus.cc:2781] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:39.775120 17212 raft_consensus.cc:686] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 LEADER]: Becoming Leader. State: Replica: 4fd578efea8448f4ba06b7ab77acbd47, State: Running, Role: LEADER
I20260811 01:00:39.775173 17212 consensus_queue.cc:237] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.775444 17215 tablet_replica.cc:439] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47: TxnStatusTablet state changed. Reason: New leader 4fd578efea8448f4ba06b7ab77acbd47. Latest consensus state: current_term: 1 leader_uuid: "4fd578efea8448f4ba06b7ab77acbd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } } }
I20260811 01:00:39.775535 17215 tablet_replica.cc:442] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:00:39.775714 17236 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 01:00:39.775851 17236 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 01:00:39.775826 16324 catalog_manager.cc:5495] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fd578efea8448f4ba06b7ab77acbd47 (127.13.30.130). New cstate: current_term: 1 leader_uuid: "4fd578efea8448f4ba06b7ab77acbd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } health_report { overall_health: UNKNOWN } } }
I20260811 01:00:39.799037 17227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.796197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:43463 (local address 127.0.0.1:47336)
0811 01:00:39.796263 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:39.796277 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:39.796337 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:39.796524 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:39.796525 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:39.796526 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:00:39.796576 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.796579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.797528 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.797528 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.798102 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.798104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.798556 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.798557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.798603 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.798620 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:00:39.798902 (+ 282us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:00:39.798906 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:00:39.798931 (+ 25us) client_negotiation.cc:240] Negotiation successful
0811 01:00:39.798968 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 01:00:39.799070 17200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.796295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47336 (local address 127.13.30.130:43463)
0811 01:00:39.796362 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.796364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.796375 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:00:39.796420 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.796422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.796445 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.796524 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:39.796632 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.797388 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.798183 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.798490 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.798560 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.798708 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:39.798844 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:39.798933 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.798948 (+ 15us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.798971 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 01:00:39.801113 17083 raft_consensus.cc:1261] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Refusing update from remote peer 4fd578efea8448f4ba06b7ab77acbd47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:39.801131 16589 raft_consensus.cc:1261] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Refusing update from remote peer 4fd578efea8448f4ba06b7ab77acbd47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:39.801463 17215 consensus_queue.cc:1035] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:39.801604 17212 consensus_queue.cc:1035] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:39.802842 17213 tablet_replica.cc:439] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33: TxnStatusTablet state changed. Reason: New leader 4fd578efea8448f4ba06b7ab77acbd47. Latest consensus state: current_term: 1 leader_uuid: "4fd578efea8448f4ba06b7ab77acbd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } } }
I20260811 01:00:39.802956 17213 tablet_replica.cc:442] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:00:39.802870 17211 tablet_replica.cc:439] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76: TxnStatusTablet state changed. Reason: New leader 4fd578efea8448f4ba06b7ab77acbd47. Latest consensus state: current_term: 1 leader_uuid: "4fd578efea8448f4ba06b7ab77acbd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } } }
I20260811 01:00:39.802989 17211 tablet_replica.cc:442] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:00:39.804337 17212 tablet_replica.cc:439] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4fd578efea8448f4ba06b7ab77acbd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } } }
I20260811 01:00:39.804431 17212 tablet_replica.cc:442] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:00:39.805133 17213 tablet_replica.cc:439] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4fd578efea8448f4ba06b7ab77acbd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } } }
I20260811 01:00:39.805222 17213 tablet_replica.cc:442] T 4103fb2f74894888872583da11a6a5c1 P 7552bec4fd0e4808a663d72a8c21ca33: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:00:39.805280 17211 tablet_replica.cc:439] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4fd578efea8448f4ba06b7ab77acbd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } } }
I20260811 01:00:39.805368 17211 tablet_replica.cc:442] T 4103fb2f74894888872583da11a6a5c1 P 0a331645cf1a404ea7b4f861c7fbcd76: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:00:39.805933 17212 tablet_replica.cc:439] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4fd578efea8448f4ba06b7ab77acbd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } } }
I20260811 01:00:39.806018 17212 tablet_replica.cc:442] T 4103fb2f74894888872583da11a6a5c1 P 4fd578efea8448f4ba06b7ab77acbd47: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:00:39.806047 17240 mvcc.cc:205] Tried to move back new op lower bound from 7317135523022868480 to 7317135522919505920. Current Snapshot: MvccSnapshot[applied={T|T < 7317135523022868480 or (T in {7317135523022868480})}]
I20260811 01:00:39.806193 17246 mvcc.cc:205] Tried to move back new op lower bound from 7317135523022868480 to 7317135522919505920. Current Snapshot: MvccSnapshot[applied={T|T < 7317135523022868480}]
I20260811 01:00:39.806205 17247 mvcc.cc:205] Tried to move back new op lower bound from 7317135523022868480 to 7317135522919505920. Current Snapshot: MvccSnapshot[applied={T|T < 7317135523022868480}]
I20260811 01:00:39.809254 17200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.806671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47352 (local address 127.13.30.130:43463)
0811 01:00:39.806722 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.806724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.806748 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:00:39.806794 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.806794 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.806805 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.806848 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:39.807012 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.807516 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.808649 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.808834 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.808881 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.809041 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:39.809074 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:39.809118 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.809160 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.809184 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 01:00:39.814683 17200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.812016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:34867 (local address 127.13.30.130:43463)
0811 01:00:39.812057 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:39.812058 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:39.812140 (+ 82us) server_negotiation.cc:407] Connection header received
0811 01:00:39.812211 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:39.812212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:39.812220 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:39.812250 (+ 30us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:39.812398 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.812843 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.814024 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.814203 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.814253 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.814465 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:39.814492 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:39.814523 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:39.814575 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 01:00:39.814598 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":20}
I20260811 01:00:39.814790 17271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:39.811929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:43463 (local address 127.13.30.130:34867)
0811 01:00:39.812079 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:39.812091 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:39.812155 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:39.812269 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:39.812269 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:39.812271 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:00:39.812352 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.812354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.812911 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.812912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.813947 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:39.813951 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:39.814266 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:39.814267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:39.814347 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:39.814368 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:00:39.814526 (+ 158us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:00:39.814528 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 01:00:39.814572 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 01:00:39.814625 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":3,"thread_start_us":70,"threads_started":1}
I20260811 01:00:39.817070 17083 raft_consensus.cc:1261] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Refusing update from remote peer 4fd578efea8448f4ba06b7ab77acbd47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:39.817073 16589 raft_consensus.cc:1261] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Refusing update from remote peer 4fd578efea8448f4ba06b7ab77acbd47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:39.817322 17252 consensus_queue.cc:1035] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:39.817497 17212 consensus_queue.cc:1035] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:39.840106 16325 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:39.840215 16325 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:39.840987 16325 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06: Sending DeleteTablet for 3 replicas of tablet 3faafee81acb45ab9bcb32b20f0e7a4a
I20260811 01:00:39.841305 16563 tablet_service.cc:1514] Processing DeleteTablet for tablet 3faafee81acb45ab9bcb32b20f0e7a4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:39 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:33002
I20260811 01:00:39.841365 16810 tablet_service.cc:1514] Processing DeleteTablet for tablet 3faafee81acb45ab9bcb32b20f0e7a4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:39 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:52340
I20260811 01:00:39.841593 17028 tablet_service.cc:1514] Processing DeleteTablet for tablet 3faafee81acb45ab9bcb32b20f0e7a4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:39 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:55016
I20260811 01:00:39.841784 17280 tablet_replica.cc:330] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47: stopping tablet replica
I20260811 01:00:39.841904 17280 raft_consensus.cc:2229] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:00:39.841908 17281 tablet_replica.cc:330] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76: stopping tablet replica
I20260811 01:00:39.841847 16325 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50772:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:00:39.842001 16325 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:00:39.842029 17280 raft_consensus.cc:2258] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:39.842252 17281 raft_consensus.cc:2229] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:39.842559 17280 ts_tablet_manager.cc:1905] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:39.842510 17281 raft_consensus.cc:2258] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:39.843096 17281 ts_tablet_manager.cc:1905] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:39.843410 16810 tablet_service.cc:1467] Processing CreateTablet for tablet d4d933a5d3da4605a235850927a2a1a4 (DEFAULT_TABLE table=test-table [id=ad198b7c4b2f4ef2a83d1d9ef92679ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:39.843592 16810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4d933a5d3da4605a235850927a2a1a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:39.844532 17280 ts_tablet_manager.cc:1918] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:00:39.844614 17280 log.cc:1196] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/3faafee81acb45ab9bcb32b20f0e7a4a
I20260811 01:00:39.844942 17280 ts_tablet_manager.cc:1939] T 3faafee81acb45ab9bcb32b20f0e7a4a P 4fd578efea8448f4ba06b7ab77acbd47: Deleting consensus metadata
I20260811 01:00:39.845103 17205 tablet_bootstrap.cc:492] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47: Bootstrap starting.
I20260811 01:00:39.845132 17281 ts_tablet_manager.cc:1918] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:00:39.845309 17281 log.cc:1196] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/3faafee81acb45ab9bcb32b20f0e7a4a
I20260811 01:00:39.845553 17205 tablet_bootstrap.cc:654] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:39.845607 17281 ts_tablet_manager.cc:1939] T 3faafee81acb45ab9bcb32b20f0e7a4a P 0a331645cf1a404ea7b4f861c7fbcd76: Deleting consensus metadata
I20260811 01:00:39.846024 17028 tablet_service.cc:1467] Processing CreateTablet for tablet d4d933a5d3da4605a235850927a2a1a4 (DEFAULT_TABLE table=test-table [id=ad198b7c4b2f4ef2a83d1d9ef92679ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:39.846130 17028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4d933a5d3da4605a235850927a2a1a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:39.846212 16563 tablet_service.cc:1467] Processing CreateTablet for tablet d4d933a5d3da4605a235850927a2a1a4 (DEFAULT_TABLE table=test-table [id=ad198b7c4b2f4ef2a83d1d9ef92679ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:39.846345 16563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4d933a5d3da4605a235850927a2a1a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:39.847232 17204 tablet_bootstrap.cc:492] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76: Bootstrap starting.
I20260811 01:00:39.847640 17204 tablet_bootstrap.cc:654] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:39.847769 17206 tablet_bootstrap.cc:492] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33: Bootstrap starting.
I20260811 01:00:39.847997 16296 catalog_manager.cc:4841] TS 4fd578efea8448f4ba06b7ab77acbd47 (127.13.30.130:43463): tablet 3faafee81acb45ab9bcb32b20f0e7a4a (table test-table [id=63a941350f394876a77f2190779f3477]) successfully deleted
I20260811 01:00:39.848100 16296 catalog_manager.cc:4841] TS 0a331645cf1a404ea7b4f861c7fbcd76 (127.13.30.131:43789): tablet 3faafee81acb45ab9bcb32b20f0e7a4a (table test-table [id=63a941350f394876a77f2190779f3477]) successfully deleted
I20260811 01:00:39.848382 17205 tablet_bootstrap.cc:492] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47: No bootstrap required, opened a new log
I20260811 01:00:39.848440 17205 ts_tablet_manager.cc:1397] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 01:00:39.848516 17206 tablet_bootstrap.cc:654] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:39.848596 17205 raft_consensus.cc:348] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.848680 17205 raft_consensus.cc:374] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:39.848712 17205 raft_consensus.cc:729] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fd578efea8448f4ba06b7ab77acbd47, State: Initialized, Role: FOLLOWER
I20260811 01:00:39.848754 17205 consensus_queue.cc:260] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.848865 17205 ts_tablet_manager.cc:1428] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 01:00:39.849248 17278 tablet_replica.cc:330] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33: stopping tablet replica
I20260811 01:00:39.849371 17278 raft_consensus.cc:2229] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:39.849459 17206 tablet_bootstrap.cc:492] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33: No bootstrap required, opened a new log
I20260811 01:00:39.849522 17206 ts_tablet_manager.cc:1397] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:00:39.849665 17206 raft_consensus.cc:348] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.849730 17206 raft_consensus.cc:374] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:39.849747 17206 raft_consensus.cc:729] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7552bec4fd0e4808a663d72a8c21ca33, State: Initialized, Role: FOLLOWER
I20260811 01:00:39.849783 17206 consensus_queue.cc:260] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.849804 17204 tablet_bootstrap.cc:492] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76: No bootstrap required, opened a new log
I20260811 01:00:39.849849 17204 ts_tablet_manager.cc:1397] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 01:00:39.849855 17206 ts_tablet_manager.cc:1428] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:39.849997 17204 raft_consensus.cc:348] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.850073 17204 raft_consensus.cc:374] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:39.850092 17204 raft_consensus.cc:729] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a331645cf1a404ea7b4f861c7fbcd76, State: Initialized, Role: FOLLOWER
I20260811 01:00:39.850136 17204 consensus_queue.cc:260] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.850229 17204 ts_tablet_manager.cc:1428] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 01:00:39.849459 17278 raft_consensus.cc:2258] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:39.851076 17278 ts_tablet_manager.cc:1905] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:39.852210 17260 raft_consensus.cc:482] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:00:39.852279 17260 raft_consensus.cc:504] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.852429 17260 leader_election.cc:288] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7552bec4fd0e4808a663d72a8c21ca33 (127.13.30.129:46695), 0a331645cf1a404ea7b4f861c7fbcd76 (127.13.30.131:43789)
I20260811 01:00:39.852447 17278 ts_tablet_manager.cc:1918] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:00:39.852506 17278 log.cc:1196] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/wal/wals/3faafee81acb45ab9bcb32b20f0e7a4a
I20260811 01:00:39.852622 16589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d933a5d3da4605a235850927a2a1a4" candidate_uuid: "4fd578efea8448f4ba06b7ab77acbd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7552bec4fd0e4808a663d72a8c21ca33" is_pre_election: true
I20260811 01:00:39.852705 16589 raft_consensus.cc:2454] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fd578efea8448f4ba06b7ab77acbd47 in term 0.
I20260811 01:00:39.852672 17083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d933a5d3da4605a235850927a2a1a4" candidate_uuid: "4fd578efea8448f4ba06b7ab77acbd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" is_pre_election: true
I20260811 01:00:39.852742 17083 raft_consensus.cc:2454] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fd578efea8448f4ba06b7ab77acbd47 in term 0.
I20260811 01:00:39.852756 17278 ts_tablet_manager.cc:1939] T 3faafee81acb45ab9bcb32b20f0e7a4a P 7552bec4fd0e4808a663d72a8c21ca33: Deleting consensus metadata
I20260811 01:00:39.852947 16721 leader_election.cc:302] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fd578efea8448f4ba06b7ab77acbd47, 7552bec4fd0e4808a663d72a8c21ca33; no voters:
I20260811 01:00:39.853083 17260 raft_consensus.cc:2781] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:00:39.853122 17260 raft_consensus.cc:482] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:00:39.853142 17260 raft_consensus.cc:3037] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:39.853861 17260 raft_consensus.cc:504] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.853995 17260 leader_election.cc:288] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [CANDIDATE]: Term 1 election: Requested vote from peers 7552bec4fd0e4808a663d72a8c21ca33 (127.13.30.129:46695), 0a331645cf1a404ea7b4f861c7fbcd76 (127.13.30.131:43789)
I20260811 01:00:39.854198 16589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d933a5d3da4605a235850927a2a1a4" candidate_uuid: "4fd578efea8448f4ba06b7ab77acbd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7552bec4fd0e4808a663d72a8c21ca33"
I20260811 01:00:39.854297 16589 raft_consensus.cc:3037] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:39.854571 17083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d933a5d3da4605a235850927a2a1a4" candidate_uuid: "4fd578efea8448f4ba06b7ab77acbd47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a331645cf1a404ea7b4f861c7fbcd76"
I20260811 01:00:39.854712 17083 raft_consensus.cc:3037] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:39.854923 16589 raft_consensus.cc:2454] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fd578efea8448f4ba06b7ab77acbd47 in term 1.
I20260811 01:00:39.855100 16721 leader_election.cc:302] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fd578efea8448f4ba06b7ab77acbd47, 7552bec4fd0e4808a663d72a8c21ca33; no voters:
I20260811 01:00:39.855219 17260 raft_consensus.cc:2781] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:39.855266 17260 raft_consensus.cc:686] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 LEADER]: Becoming Leader. State: Replica: 4fd578efea8448f4ba06b7ab77acbd47, State: Running, Role: LEADER
I20260811 01:00:39.855306 17260 consensus_queue.cc:237] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:39.855365 17083 raft_consensus.cc:2454] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fd578efea8448f4ba06b7ab77acbd47 in term 1.
I20260811 01:00:39.855597 16292 catalog_manager.cc:4841] TS 7552bec4fd0e4808a663d72a8c21ca33 (127.13.30.129:46695): tablet 3faafee81acb45ab9bcb32b20f0e7a4a (table test-table [id=63a941350f394876a77f2190779f3477]) successfully deleted
I20260811 01:00:39.855870 16325 catalog_manager.cc:5495] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fd578efea8448f4ba06b7ab77acbd47 (127.13.30.130). New cstate: current_term: 1 leader_uuid: "4fd578efea8448f4ba06b7ab77acbd47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } health_report { overall_health: UNKNOWN } } }
I20260811 01:00:39.863509 16589 raft_consensus.cc:1261] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Refusing update from remote peer 4fd578efea8448f4ba06b7ab77acbd47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:39.863512 17083 raft_consensus.cc:1261] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Refusing update from remote peer 4fd578efea8448f4ba06b7ab77acbd47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:39.863729 17260 consensus_queue.cc:1035] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:39.863835 17252 consensus_queue.cc:1035] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 01:00:39.868969 17240 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 01:00:41.386873 16325 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:41.387006 16325 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:41.387905 16325 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06: Sending DeleteTablet for 3 replicas of tablet d4d933a5d3da4605a235850927a2a1a4
I20260811 01:00:41.388159 16812 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d933a5d3da4605a235850927a2a1a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:41 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:52340
I20260811 01:00:41.388209 16563 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d933a5d3da4605a235850927a2a1a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:41 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:33002
I20260811 01:00:41.388201 17028 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d933a5d3da4605a235850927a2a1a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:41 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:55016
I20260811 01:00:41.389782 17340 tablet_replica.cc:330] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33: stopping tablet replica
I20260811 01:00:41.389914 17340 raft_consensus.cc:2229] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:41.390014 17340 raft_consensus.cc:2258] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:41.390182 17336 tablet_replica.cc:330] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76: stopping tablet replica
I20260811 01:00:41.390311 17332 tablet_replica.cc:330] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47: stopping tablet replica
I20260811 01:00:41.390381 17332 raft_consensus.cc:2229] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:00:41.390465 17332 raft_consensus.cc:2258] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:41.390561 17336 raft_consensus.cc:2229] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:41.390627 17336 raft_consensus.cc:2258] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:41.390750 17340 ts_tablet_manager.cc:1905] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:41.390767 17332 ts_tablet_manager.cc:1905] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:41.390916 17336 ts_tablet_manager.cc:1905] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:41.392422 17332 ts_tablet_manager.cc:1918] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:00:41.392432 17340 ts_tablet_manager.cc:1918] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:00:41.392494 17340 log.cc:1196] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/wal/wals/d4d933a5d3da4605a235850927a2a1a4
I20260811 01:00:41.392567 17336 ts_tablet_manager.cc:1918] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:00:41.392612 17332 log.cc:1196] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/d4d933a5d3da4605a235850927a2a1a4
I20260811 01:00:41.392632 17336 log.cc:1196] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/d4d933a5d3da4605a235850927a2a1a4
I20260811 01:00:41.392714 17340 ts_tablet_manager.cc:1939] T d4d933a5d3da4605a235850927a2a1a4 P 7552bec4fd0e4808a663d72a8c21ca33: Deleting consensus metadata
I20260811 01:00:41.392851 17332 ts_tablet_manager.cc:1939] T d4d933a5d3da4605a235850927a2a1a4 P 4fd578efea8448f4ba06b7ab77acbd47: Deleting consensus metadata
I20260811 01:00:41.392853 17336 ts_tablet_manager.cc:1939] T d4d933a5d3da4605a235850927a2a1a4 P 0a331645cf1a404ea7b4f861c7fbcd76: Deleting consensus metadata
I20260811 01:00:41.393193 16292 catalog_manager.cc:4841] TS 7552bec4fd0e4808a663d72a8c21ca33 (127.13.30.129:46695): tablet d4d933a5d3da4605a235850927a2a1a4 (table test-table [id=ad198b7c4b2f4ef2a83d1d9ef92679ab]) successfully deleted
I20260811 01:00:41.393198 16296 catalog_manager.cc:4841] TS 4fd578efea8448f4ba06b7ab77acbd47 (127.13.30.130:43463): tablet d4d933a5d3da4605a235850927a2a1a4 (table test-table [id=ad198b7c4b2f4ef2a83d1d9ef92679ab]) successfully deleted
I20260811 01:00:41.393313 16296 catalog_manager.cc:4841] TS 0a331645cf1a404ea7b4f861c7fbcd76 (127.13.30.131:43789): tablet d4d933a5d3da4605a235850927a2a1a4 (table test-table [id=ad198b7c4b2f4ef2a83d1d9ef92679ab]) successfully deleted
Aug 11 01:00:41 dist-test-slave-42z9 krb5kdc[16242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410041, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:00:41 dist-test-slave-42z9 krb5kdc[16242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410041, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:41.415318 17351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.407758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38244 (local address 127.13.30.190:35083)
0811 01:00:41.407899 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:41.407900 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:41.407911 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:00:41.407973 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:41.407974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:41.407985 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:41.408047 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:41.409015 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.409651 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.410415 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.410615 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.410663 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.412943 (+ 2280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:41.412945 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:41.412946 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:41.412956 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:41.414384 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:41.414718 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:41.414719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:41.414719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:41.414770 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:41.414899 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:41.414900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:41.414900 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:41.415008 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:41.415080 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:41.415155 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 01:00:41.415226 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":88,"threads_started":1}
I20260811 01:00:41.416776 16325 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38244:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:00:41.416939 16325 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:00:41.418300 16563 tablet_service.cc:1467] Processing CreateTablet for tablet 7d53d901d67e4136a090198891059abd (DEFAULT_TABLE table=test-table [id=7bd9a135b720453bbbd4b039d0c9909b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:41.418344 16812 tablet_service.cc:1467] Processing CreateTablet for tablet 7d53d901d67e4136a090198891059abd (DEFAULT_TABLE table=test-table [id=7bd9a135b720453bbbd4b039d0c9909b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:41.418391 17028 tablet_service.cc:1467] Processing CreateTablet for tablet 7d53d901d67e4136a090198891059abd (DEFAULT_TABLE table=test-table [id=7bd9a135b720453bbbd4b039d0c9909b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:41.418457 16563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d53d901d67e4136a090198891059abd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:41.418496 16812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d53d901d67e4136a090198891059abd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:41.418506 17028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d53d901d67e4136a090198891059abd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:41.420042 17356 tablet_bootstrap.cc:492] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33: Bootstrap starting.
I20260811 01:00:41.420073 17353 tablet_bootstrap.cc:492] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47: Bootstrap starting.
I20260811 01:00:41.420434 17356 tablet_bootstrap.cc:654] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:41.420538 17353 tablet_bootstrap.cc:654] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:41.420781 17355 tablet_bootstrap.cc:492] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76: Bootstrap starting.
I20260811 01:00:41.421087 17356 tablet_bootstrap.cc:492] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33: No bootstrap required, opened a new log
I20260811 01:00:41.421123 17353 tablet_bootstrap.cc:492] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47: No bootstrap required, opened a new log
I20260811 01:00:41.421137 17356 ts_tablet_manager.cc:1397] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:41.421173 17353 ts_tablet_manager.cc:1397] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:41.421206 17355 tablet_bootstrap.cc:654] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:41.421288 17353 raft_consensus.cc:348] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.421299 17356 raft_consensus.cc:348] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.421373 17356 raft_consensus.cc:374] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:41.421375 17353 raft_consensus.cc:374] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:41.421391 17356 raft_consensus.cc:729] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7552bec4fd0e4808a663d72a8c21ca33, State: Initialized, Role: FOLLOWER
I20260811 01:00:41.421394 17353 raft_consensus.cc:729] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fd578efea8448f4ba06b7ab77acbd47, State: Initialized, Role: FOLLOWER
I20260811 01:00:41.421494 17353 consensus_queue.cc:260] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.421489 17356 consensus_queue.cc:260] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.421603 17353 ts_tablet_manager.cc:1428] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 01:00:41.421679 17356 ts_tablet_manager.cc:1428] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:41.421969 17355 tablet_bootstrap.cc:492] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76: No bootstrap required, opened a new log
I20260811 01:00:41.422024 17355 ts_tablet_manager.cc:1397] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:41.422163 17355 raft_consensus.cc:348] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.422263 17355 raft_consensus.cc:374] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:41.422282 17355 raft_consensus.cc:729] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a331645cf1a404ea7b4f861c7fbcd76, State: Initialized, Role: FOLLOWER
I20260811 01:00:41.422322 17355 consensus_queue.cc:260] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.422509 17355 ts_tablet_manager.cc:1428] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:41.423699 17363 raft_consensus.cc:482] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:00:41.423758 17363 raft_consensus.cc:504] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.424033 17363 leader_election.cc:288] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4fd578efea8448f4ba06b7ab77acbd47 (127.13.30.130:43463), 0a331645cf1a404ea7b4f861c7fbcd76 (127.13.30.131:43789)
I20260811 01:00:41.427392 17374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.424174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:43463 (local address 127.13.30.129:45209)
0811 01:00:41.424490 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:41.424500 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:41.424576 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:41.424743 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:41.424744 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:41.424746 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:41.424825 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.424827 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.425517 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.425518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.426394 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.426397 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.427113 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.427114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.427198 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.427202 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:00:41.427246 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 01:00:41.427290 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":18,"thread_start_us":87,"threads_started":1}
I20260811 01:00:41.427373 17368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.424225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:45209 (local address 127.13.30.130:43463)
0811 01:00:41.424403 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:41.424405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:41.424549 (+ 144us) server_negotiation.cc:407] Connection header received
0811 01:00:41.424655 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:41.424657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:41.424668 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:41.424735 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:41.424890 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.425378 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.426487 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.427044 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.427115 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.427126 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:41.427259 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 01:00:41.427301 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":98,"threads_started":1}
I20260811 01:00:41.427606 16838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d53d901d67e4136a090198891059abd" candidate_uuid: "7552bec4fd0e4808a663d72a8c21ca33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fd578efea8448f4ba06b7ab77acbd47" is_pre_election: true
I20260811 01:00:41.427758 16838 raft_consensus.cc:2454] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7552bec4fd0e4808a663d72a8c21ca33 in term 0.
I20260811 01:00:41.427943 17375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.424438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:44775 (local address 127.13.30.131:43789)
0811 01:00:41.424580 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:41.424582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:41.424590 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:00:41.424640 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:41.424641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:41.424651 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:41.424706 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:41.424859 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.425385 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.427057 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.427593 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.427663 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.427671 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:41.427826 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 01:00:41.427871 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":88,"threads_started":1}
I20260811 01:00:41.427958 16483 leader_election.cc:302] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fd578efea8448f4ba06b7ab77acbd47, 7552bec4fd0e4808a663d72a8c21ca33; no voters:
I20260811 01:00:41.428041 17365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.424378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:43789 (local address 127.13.30.129:44775)
0811 01:00:41.424530 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:41.424541 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:41.424591 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:41.424718 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:41.424718 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:41.424721 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:41.424794 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.424796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.425488 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.425489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.426947 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.426951 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.427677 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.427678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.427751 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.427755 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:00:41.427816 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 01:00:41.427928 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":55,"thread_start_us":74,"threads_started":1}
I20260811 01:00:41.428103 17363 raft_consensus.cc:2781] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:00:41.428143 17363 raft_consensus.cc:482] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:00:41.428162 17363 raft_consensus.cc:3037] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:41.428246 17083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d53d901d67e4136a090198891059abd" candidate_uuid: "7552bec4fd0e4808a663d72a8c21ca33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" is_pre_election: true
I20260811 01:00:41.428325 17083 raft_consensus.cc:2454] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7552bec4fd0e4808a663d72a8c21ca33 in term 0.
I20260811 01:00:41.428973 17363 raft_consensus.cc:504] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.429083 17363 leader_election.cc:288] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [CANDIDATE]: Term 1 election: Requested vote from peers 4fd578efea8448f4ba06b7ab77acbd47 (127.13.30.130:43463), 0a331645cf1a404ea7b4f861c7fbcd76 (127.13.30.131:43789)
I20260811 01:00:41.429232 17083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d53d901d67e4136a090198891059abd" candidate_uuid: "7552bec4fd0e4808a663d72a8c21ca33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a331645cf1a404ea7b4f861c7fbcd76"
I20260811 01:00:41.429311 17083 raft_consensus.cc:3037] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:41.429531 16838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d53d901d67e4136a090198891059abd" candidate_uuid: "7552bec4fd0e4808a663d72a8c21ca33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fd578efea8448f4ba06b7ab77acbd47"
I20260811 01:00:41.429600 16838 raft_consensus.cc:3037] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:41.430177 16838 raft_consensus.cc:2454] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7552bec4fd0e4808a663d72a8c21ca33 in term 1.
I20260811 01:00:41.430341 16483 leader_election.cc:302] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fd578efea8448f4ba06b7ab77acbd47, 7552bec4fd0e4808a663d72a8c21ca33; no voters:
I20260811 01:00:41.430447 17363 raft_consensus.cc:2781] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:41.430624 17363 raft_consensus.cc:686] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 LEADER]: Becoming Leader. State: Replica: 7552bec4fd0e4808a663d72a8c21ca33, State: Running, Role: LEADER
I20260811 01:00:41.430702 17363 consensus_queue.cc:237] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.430855 17083 raft_consensus.cc:2454] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7552bec4fd0e4808a663d72a8c21ca33 in term 1.
I20260811 01:00:41.431361 16326 catalog_manager.cc:5495] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7552bec4fd0e4808a663d72a8c21ca33 (127.13.30.129). New cstate: current_term: 1 leader_uuid: "7552bec4fd0e4808a663d72a8c21ca33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } health_report { overall_health: UNKNOWN } } }
I20260811 01:00:41.441179 17381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.438674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50634 (local address 127.13.30.129:46695)
0811 01:00:41.438840 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:41.438841 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:41.438847 (+ 6us) server_negotiation.cc:407] Connection header received
0811 01:00:41.438884 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:41.438884 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:41.438904 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:41.438983 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:41.439121 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.439635 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.440372 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.440594 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.440648 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.440824 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:41.440949 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:41.441014 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:41.441055 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 01:00:41.441083 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":94,"threads_started":1}
I20260811 01:00:41.445842 17368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.443571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:42433 (local address 127.13.30.130:43463)
0811 01:00:41.443628 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:41.443630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:41.443720 (+ 90us) server_negotiation.cc:407] Connection header received
0811 01:00:41.443771 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:41.443772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:41.443782 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:41.443819 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:41.443942 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.444480 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.445183 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.445384 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.445433 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.445651 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:41.445681 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:41.445719 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:41.445759 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 01:00:41.445780 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 01:00:41.445859 17385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.443505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:43463 (local address 127.13.30.129:42433)
0811 01:00:41.443659 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:41.443669 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:41.443723 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:41.443830 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:41.443830 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:41.443831 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:00:41.443895 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.443896 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.444536 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.444537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.445115 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.445117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.445503 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.445504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.445568 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.445584 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:00:41.445726 (+ 142us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:00:41.445727 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 01:00:41.445756 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 01:00:41.445792 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260811 01:00:41.448259 17083 raft_consensus.cc:1261] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Refusing update from remote peer 7552bec4fd0e4808a663d72a8c21ca33: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:41.448361 16838 raft_consensus.cc:1261] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Refusing update from remote peer 7552bec4fd0e4808a663d72a8c21ca33: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:41.448540 17363 consensus_queue.cc:1035] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:41.448705 17378 consensus_queue.cc:1035] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:41.456368 17381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.454125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:32779 (local address 127.13.30.129:46695)
0811 01:00:41.454174 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:41.454177 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:41.454280 (+ 103us) server_negotiation.cc:407] Connection header received
0811 01:00:41.454329 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:41.454329 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:41.454338 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:41.454380 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:41.454468 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.454938 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.455634 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.455891 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.455968 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.456127 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:41.456164 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:41.456214 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:41.456288 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 01:00:41.456310 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 01:00:41.456395 17392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.454085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:46695 (local address 127.13.30.130:32779)
0811 01:00:41.454224 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:41.454235 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:41.454288 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:41.454383 (+ 95us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:41.454384 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:41.454385 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:00:41.454434 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.454435 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.454989 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.454990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.455547 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.455549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.455969 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.455970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.456050 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.456057 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:00:41.456241 (+ 184us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:00:41.456243 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 01:00:41.456284 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 01:00:41.456330 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":89,"threads_started":1}
I20260811 01:00:41.462884 16326 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38244:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:41.462992 16326 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38244:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:41.463613 16326 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06: Sending DeleteTablet for 3 replicas of tablet 7d53d901d67e4136a090198891059abd
I20260811 01:00:41.463893 16812 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d53d901d67e4136a090198891059abd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:41 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:52340
I20260811 01:00:41.463910 17028 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d53d901d67e4136a090198891059abd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:41 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:55016
I20260811 01:00:41.463992 17332 tablet_replica.cc:330] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47: stopping tablet replica
I20260811 01:00:41.463992 17336 tablet_replica.cc:330] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76: stopping tablet replica
I20260811 01:00:41.464035 17336 raft_consensus.cc:2229] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:41.464039 17332 raft_consensus.cc:2229] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:41.464075 17336 raft_consensus.cc:2258] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:41.464088 17332 raft_consensus.cc:2258] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:41.464260 16563 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d53d901d67e4136a090198891059abd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:41 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:33002
I20260811 01:00:41.464344 17340 tablet_replica.cc:330] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33: stopping tablet replica
I20260811 01:00:41.464385 17340 raft_consensus.cc:2229] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:00:41.464402 17332 ts_tablet_manager.cc:1905] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:41.464475 17340 raft_consensus.cc:2258] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:41.464453 17336 ts_tablet_manager.cc:1905] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:41.464774 17340 ts_tablet_manager.cc:1905] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:41.466053 17336 ts_tablet_manager.cc:1918] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:00:41.466110 17336 log.cc:1196] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/7d53d901d67e4136a090198891059abd
I20260811 01:00:41.466105 17332 ts_tablet_manager.cc:1918] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:00:41.466161 17332 log.cc:1196] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/7d53d901d67e4136a090198891059abd
I20260811 01:00:41.466245 17340 ts_tablet_manager.cc:1918] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:00:41.466292 17340 log.cc:1196] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-0/wal/wals/7d53d901d67e4136a090198891059abd
I20260811 01:00:41.466332 17336 ts_tablet_manager.cc:1939] T 7d53d901d67e4136a090198891059abd P 0a331645cf1a404ea7b4f861c7fbcd76: Deleting consensus metadata
I20260811 01:00:41.466379 17332 ts_tablet_manager.cc:1939] T 7d53d901d67e4136a090198891059abd P 4fd578efea8448f4ba06b7ab77acbd47: Deleting consensus metadata
I20260811 01:00:41.466480 17340 ts_tablet_manager.cc:1939] T 7d53d901d67e4136a090198891059abd P 7552bec4fd0e4808a663d72a8c21ca33: Deleting consensus metadata
I20260811 01:00:41.466686 16296 catalog_manager.cc:4841] TS 0a331645cf1a404ea7b4f861c7fbcd76 (127.13.30.131:43789): tablet 7d53d901d67e4136a090198891059abd (table test-table [id=7bd9a135b720453bbbd4b039d0c9909b]) successfully deleted
I20260811 01:00:41.466759 16292 catalog_manager.cc:4841] TS 7552bec4fd0e4808a663d72a8c21ca33 (127.13.30.129:46695): tablet 7d53d901d67e4136a090198891059abd (table test-table [id=7bd9a135b720453bbbd4b039d0c9909b]) successfully deleted
I20260811 01:00:41.466828 16296 catalog_manager.cc:4841] TS 4fd578efea8448f4ba06b7ab77acbd47 (127.13.30.130:43463): tablet 7d53d901d67e4136a090198891059abd (table test-table [id=7bd9a135b720453bbbd4b039d0c9909b]) successfully deleted
I20260811 01:00:41.467342 16326 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38244:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:00:41.467530 16326 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:00:41.468776 16563 tablet_service.cc:1467] Processing CreateTablet for tablet b286e4d62ed341f88b16ac72eb431211 (DEFAULT_TABLE table=test-table [id=203df5c2f1f849aea21b28f93a170baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:41.468855 17028 tablet_service.cc:1467] Processing CreateTablet for tablet b286e4d62ed341f88b16ac72eb431211 (DEFAULT_TABLE table=test-table [id=203df5c2f1f849aea21b28f93a170baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:41.468932 16563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b286e4d62ed341f88b16ac72eb431211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:41.468961 17028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b286e4d62ed341f88b16ac72eb431211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:41.470276 17355 tablet_bootstrap.cc:492] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76: Bootstrap starting.
I20260811 01:00:41.470320 17356 tablet_bootstrap.cc:492] T b286e4d62ed341f88b16ac72eb431211 P 7552bec4fd0e4808a663d72a8c21ca33: Bootstrap starting.
I20260811 01:00:41.470710 17355 tablet_bootstrap.cc:654] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:41.470865 17356 tablet_bootstrap.cc:654] T b286e4d62ed341f88b16ac72eb431211 P 7552bec4fd0e4808a663d72a8c21ca33: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:41.471257 16812 tablet_service.cc:1467] Processing CreateTablet for tablet b286e4d62ed341f88b16ac72eb431211 (DEFAULT_TABLE table=test-table [id=203df5c2f1f849aea21b28f93a170baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:41.471400 16812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b286e4d62ed341f88b16ac72eb431211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:41.471393 17355 tablet_bootstrap.cc:492] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76: No bootstrap required, opened a new log
I20260811 01:00:41.471448 17355 ts_tablet_manager.cc:1397] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:41.471616 17355 raft_consensus.cc:348] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.471697 17355 raft_consensus.cc:374] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:41.471715 17355 raft_consensus.cc:729] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a331645cf1a404ea7b4f861c7fbcd76, State: Initialized, Role: FOLLOWER
I20260811 01:00:41.471755 17355 consensus_queue.cc:260] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.471837 17355 ts_tablet_manager.cc:1428] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:41.472472 17356 tablet_bootstrap.cc:492] T b286e4d62ed341f88b16ac72eb431211 P 7552bec4fd0e4808a663d72a8c21ca33: No bootstrap required, opened a new log
I20260811 01:00:41.472529 17356 ts_tablet_manager.cc:1397] T b286e4d62ed341f88b16ac72eb431211 P 7552bec4fd0e4808a663d72a8c21ca33: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:00:41.472693 17356 raft_consensus.cc:348] T b286e4d62ed341f88b16ac72eb431211 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.472779 17356 raft_consensus.cc:374] T b286e4d62ed341f88b16ac72eb431211 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:41.472800 17356 raft_consensus.cc:729] T b286e4d62ed341f88b16ac72eb431211 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7552bec4fd0e4808a663d72a8c21ca33, State: Initialized, Role: FOLLOWER
I20260811 01:00:41.472844 17356 consensus_queue.cc:260] T b286e4d62ed341f88b16ac72eb431211 P 7552bec4fd0e4808a663d72a8c21ca33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.472965 17356 ts_tablet_manager.cc:1428] T b286e4d62ed341f88b16ac72eb431211 P 7552bec4fd0e4808a663d72a8c21ca33: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:41.473074 17353 tablet_bootstrap.cc:492] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47: Bootstrap starting.
I20260811 01:00:41.473519 17353 tablet_bootstrap.cc:654] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:41.474084 17353 tablet_bootstrap.cc:492] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47: No bootstrap required, opened a new log
I20260811 01:00:41.474141 17353 ts_tablet_manager.cc:1397] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:41.474254 17353 raft_consensus.cc:348] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.474318 17353 raft_consensus.cc:374] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:41.474336 17353 raft_consensus.cc:729] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fd578efea8448f4ba06b7ab77acbd47, State: Initialized, Role: FOLLOWER
I20260811 01:00:41.474380 17353 consensus_queue.cc:260] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.474475 17353 ts_tablet_manager.cc:1428] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:41.482503 17364 raft_consensus.cc:482] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:00:41.482613 17364 raft_consensus.cc:504] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.483004 17364 leader_election.cc:288] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7552bec4fd0e4808a663d72a8c21ca33 (127.13.30.129:46695), 4fd578efea8448f4ba06b7ab77acbd47 (127.13.30.130:43463)
I20260811 01:00:41.486975 17381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.483306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:35613 (local address 127.13.30.129:46695)
0811 01:00:41.483355 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:41.483357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:41.483609 (+ 252us) server_negotiation.cc:407] Connection header received
0811 01:00:41.483706 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:41.483707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:41.483719 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:41.483771 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:41.483907 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.484410 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.486044 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.486630 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.486707 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.486718 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:41.486859 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 01:00:41.486908 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 01:00:41.487051 17402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.483199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:46695 (local address 127.13.30.131:35613)
0811 01:00:41.483559 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:41.483568 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:41.483616 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:41.483791 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:41.483792 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:41.483794 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:41.483852 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.483854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.484494 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.484495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.485944 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.485949 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.486718 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.486719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.486786 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.486790 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:00:41.486832 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 01:00:41.486883 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":119,"threads_started":1}
I20260811 01:00:41.487358 16589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b286e4d62ed341f88b16ac72eb431211" candidate_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7552bec4fd0e4808a663d72a8c21ca33" is_pre_election: true
I20260811 01:00:41.487475 16589 raft_consensus.cc:2454] T b286e4d62ed341f88b16ac72eb431211 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a331645cf1a404ea7b4f861c7fbcd76 in term 0.
I20260811 01:00:41.487650 16968 leader_election.cc:302] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a331645cf1a404ea7b4f861c7fbcd76, 7552bec4fd0e4808a663d72a8c21ca33; no voters:
I20260811 01:00:41.487788 17368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.483417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:54791 (local address 127.13.30.130:43463)
0811 01:00:41.483483 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:41.483485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:41.483494 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:00:41.483552 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:41.483553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:41.483567 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:41.483625 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:41.483832 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.484589 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.486762 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.487348 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.487446 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.487456 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:41.487666 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 01:00:41.487723 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 01:00:41.487792 17364 raft_consensus.cc:2781] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:00:41.487833 17364 raft_consensus.cc:482] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:00:41.487972 17364 raft_consensus.cc:3037] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:41.489004 17364 raft_consensus.cc:504] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.489180 17364 leader_election.cc:288] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [CANDIDATE]: Term 1 election: Requested vote from peers 7552bec4fd0e4808a663d72a8c21ca33 (127.13.30.129:46695), 4fd578efea8448f4ba06b7ab77acbd47 (127.13.30.130:43463)
I20260811 01:00:41.487797 17401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.483178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:43463 (local address 127.13.30.131:54791)
0811 01:00:41.483415 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:41.483425 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:41.483488 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:41.483652 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:41.483653 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:41.483655 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:41.483745 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.483748 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.484691 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.484692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.485945 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.485949 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.487496 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.487497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.487598 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.487602 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:00:41.487655 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 01:00:41.487703 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":3,"thread_start_us":63,"threads_started":1}
I20260811 01:00:41.489526 16589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b286e4d62ed341f88b16ac72eb431211" candidate_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7552bec4fd0e4808a663d72a8c21ca33"
I20260811 01:00:41.489621 16589 raft_consensus.cc:3037] T b286e4d62ed341f88b16ac72eb431211 P 7552bec4fd0e4808a663d72a8c21ca33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:41.489622 16838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b286e4d62ed341f88b16ac72eb431211" candidate_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fd578efea8448f4ba06b7ab77acbd47" is_pre_election: true
I20260811 01:00:41.489701 16838 raft_consensus.cc:2454] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a331645cf1a404ea7b4f861c7fbcd76 in term 0.
I20260811 01:00:41.489655 16837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b286e4d62ed341f88b16ac72eb431211" candidate_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fd578efea8448f4ba06b7ab77acbd47"
I20260811 01:00:41.489748 16837 raft_consensus.cc:3037] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:41.490365 16589 raft_consensus.cc:2454] T b286e4d62ed341f88b16ac72eb431211 P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a331645cf1a404ea7b4f861c7fbcd76 in term 1.
I20260811 01:00:41.490367 16837 raft_consensus.cc:2454] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a331645cf1a404ea7b4f861c7fbcd76 in term 1.
I20260811 01:00:41.490542 16968 leader_election.cc:302] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a331645cf1a404ea7b4f861c7fbcd76, 7552bec4fd0e4808a663d72a8c21ca33; no voters:
I20260811 01:00:41.490643 17364 raft_consensus.cc:2781] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:41.490808 17364 raft_consensus.cc:686] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 LEADER]: Becoming Leader. State: Replica: 0a331645cf1a404ea7b4f861c7fbcd76, State: Running, Role: LEADER
I20260811 01:00:41.490882 17364 consensus_queue.cc:237] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } }
I20260811 01:00:41.491591 16325 catalog_manager.cc:5495] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a331645cf1a404ea7b4f861c7fbcd76 (127.13.30.131). New cstate: current_term: 1 leader_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a331645cf1a404ea7b4f861c7fbcd76" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43789 } health_report { overall_health: HEALTHY } } }
I20260811 01:00:41.503501 17375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.500859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59246 (local address 127.13.30.131:43789)
0811 01:00:41.500918 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:41.500920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:41.500954 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:00:41.501039 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:41.501040 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:41.501060 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:41.501123 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:41.501249 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.501778 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.502793 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.502988 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.503028 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.503184 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:41.503296 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:41.503348 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:41.503405 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 01:00:41.503427 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 01:00:41.508788 17409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.506098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:43463 (local address 127.13.30.131:60125)
0811 01:00:41.506335 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:41.506346 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:41.506419 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:41.506529 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:41.506530 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:41.506531 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:00:41.506600 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.506602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.507253 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.507255 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.507977 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.507980 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.508342 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.508343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.508407 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.508426 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:00:41.508608 (+ 182us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:00:41.508610 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 01:00:41.508651 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 01:00:41.508704 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":147,"threads_started":1}
I20260811 01:00:41.508765 17368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.506245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:60125 (local address 127.13.30.130:43463)
0811 01:00:41.506320 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:41.506321 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:41.506400 (+ 79us) server_negotiation.cc:407] Connection header received
0811 01:00:41.506469 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:41.506470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:41.506481 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:41.506528 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:41.506674 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.507177 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.508062 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.508262 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.508316 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.508505 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:41.508539 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:41.508581 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:41.508652 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 01:00:41.508678 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 01:00:41.511036 16837 raft_consensus.cc:1261] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Refusing update from remote peer 0a331645cf1a404ea7b4f861c7fbcd76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:41.511076 16589 raft_consensus.cc:1261] T b286e4d62ed341f88b16ac72eb431211 P 7552bec4fd0e4808a663d72a8c21ca33 [term 1 FOLLOWER]: Refusing update from remote peer 0a331645cf1a404ea7b4f861c7fbcd76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:41.511327 17364 consensus_queue.cc:1035] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fd578efea8448f4ba06b7ab77acbd47" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:41.511492 17403 consensus_queue.cc:1035] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7552bec4fd0e4808a663d72a8c21ca33" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:41.519718 17375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.516932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:52607 (local address 127.13.30.131:43789)
0811 01:00:41.516974 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:41.516976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:41.516986 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:00:41.517033 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:41.517033 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:41.517045 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:41.517095 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:41.517209 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.517883 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.519000 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.519227 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.519300 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.519475 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:41.519517 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:41.519558 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:41.519630 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 01:00:41.519657 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 01:00:41.519766 17392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:41.516835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:43789 (local address 127.13.30.130:52607)
0811 01:00:41.516927 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:41.516939 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:41.516978 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:41.517098 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:41.517098 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:41.517099 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:00:41.517154 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.517156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.517969 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.517970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.518923 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:41.518927 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:41.519310 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:41.519310 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:41.519382 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:41.519390 (+ 8us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:00:41.519578 (+ 188us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:00:41.519579 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 01:00:41.519624 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 01:00:41.519681 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
W20260811 01:00:41.520144 17297 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 01:00:43.047312 16325 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38244:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:43.047436 16325 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38244:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:43.048621 16325 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a66a82b014c74d6b920b9567e0115e06: Sending DeleteTablet for 3 replicas of tablet b286e4d62ed341f88b16ac72eb431211
I20260811 01:00:43.048949 17028 tablet_service.cc:1514] Processing DeleteTablet for tablet b286e4d62ed341f88b16ac72eb431211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:43 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:55016
I20260811 01:00:43.049015 16563 tablet_service.cc:1514] Processing DeleteTablet for tablet b286e4d62ed341f88b16ac72eb431211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:43 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:33002
I20260811 01:00:43.049017 16812 tablet_service.cc:1514] Processing DeleteTablet for tablet b286e4d62ed341f88b16ac72eb431211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:43 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:52340
I20260811 01:00:43.049108 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 16450
I20260811 01:00:43.058856 17468 tablet_replica.cc:330] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47: stopping tablet replica
I20260811 01:00:43.059003 17468 raft_consensus.cc:2229] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:43.059126 17468 raft_consensus.cc:2258] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:43.059526 17468 ts_tablet_manager.cc:1905] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:43.061240 17468 ts_tablet_manager.cc:1918] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:00:43.061331 17468 log.cc:1196] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/b286e4d62ed341f88b16ac72eb431211
I20260811 01:00:43.061573 17468 ts_tablet_manager.cc:1939] T b286e4d62ed341f88b16ac72eb431211 P 4fd578efea8448f4ba06b7ab77acbd47: Deleting consensus metadata
I20260811 01:00:43.061682 17465 tablet_replica.cc:330] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76: stopping tablet replica
I20260811 01:00:43.061759 17465 raft_consensus.cc:2229] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:00:43.061901 17465 raft_consensus.cc:2258] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:43.061983 16296 catalog_manager.cc:4841] TS 4fd578efea8448f4ba06b7ab77acbd47 (127.13.30.130:43463): tablet b286e4d62ed341f88b16ac72eb431211 (table test-table [id=203df5c2f1f849aea21b28f93a170baa]) successfully deleted
I20260811 01:00:43.062178 17465 ts_tablet_manager.cc:1905] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:43.063582 17465 ts_tablet_manager.cc:1918] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:00:43.063647 17465 log.cc:1196] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/b286e4d62ed341f88b16ac72eb431211
I20260811 01:00:43.063858 17465 ts_tablet_manager.cc:1939] T b286e4d62ed341f88b16ac72eb431211 P 0a331645cf1a404ea7b4f861c7fbcd76: Deleting consensus metadata
I20260811 01:00:43.064234 16296 catalog_manager.cc:4841] TS 0a331645cf1a404ea7b4f861c7fbcd76 (127.13.30.131:43789): tablet b286e4d62ed341f88b16ac72eb431211 (table test-table [id=203df5c2f1f849aea21b28f93a170baa]) successfully deleted
W20260811 01:00:43.065843 16292 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:46695 (error 108)
I20260811 01:00:43.066205 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 16696
I20260811 01:00:43.073109 17470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:43.066391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:46695 (local address 127.0.0.1:50638)
0811 01:00:43.072927 (+ 6536us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:43.073041 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:46695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6486,"thread_start_us":67,"threads_started":1}
W20260811 01:00:43.073271 16292 catalog_manager.cc:4584] TS 7552bec4fd0e4808a663d72a8c21ca33 (127.13.30.129:46695): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b286e4d62ed341f88b16ac72eb431211: Network error: Client connection negotiation failed: client connection to 127.13.30.129:46695: connect: Connection refused (error 111)
I20260811 01:00:43.082521 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 16942
I20260811 01:00:43.102937 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 16264
2026-08-11T01:00:43Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5711 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:43 dist-test-slave-42z9 krb5kdc[17475](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:43 dist-test-slave-42z9 krb5kdc[17475](info): set up 2 sockets
Aug 11 01:00:43 dist-test-slave-42z9 krb5kdc[17475](info): commencing operation
krb5kdc: starting...
W20260811 01:00:44.286862 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:00:44 dist-test-slave-42z9 krb5kdc[17475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410044, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:00:44.420796 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:36331
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:36795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:36331
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:44.509802 17497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:44.510079 17497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:44.510116 17497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:44.511452 17497 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:44.511515 17497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:44.511534 17497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:44.511550 17497 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:44.511564 17497 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:44.513314 17497 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:36331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:36331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:44.513669 17497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:44.513953 17497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:44.520033 17509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:44.520152 17497 server_base.cc:1034] running on GCE node
W20260811 01:00:44.520036 17503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:44.520152 17504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:44.520661 17497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:44.521034 17497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:44.522192 17497 hybrid_clock.cc:648] HybridClock initialized: now 1786410044522176 us; error 42 us; skew 500 ppm
Aug 11 01:00:44 dist-test-slave-42z9 krb5kdc[17475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410044, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:44.529659 17497 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:00:44.530176 17497 webserver.cc:460] Webserver started at http://127.13.30.190:36403/ using document root <none> and password file <none>
I20260811 01:00:44.530401 17497 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:44.530462 17497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:44.530604 17497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:44.531773 17497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "ca494e704cea4946b02d42143853e900"
format_stamp: "Formatted at 2026-08-11 01:00:44 on dist-test-slave-42z9"
server_key: "a32b62b78132506c4317c63fc9b797f7"
server_key_iv: "a95df8f1f6091394dade3926ea4c9157"
server_key_version: "encryptionkey@0"
I20260811 01:00:44.532141 17497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "ca494e704cea4946b02d42143853e900"
format_stamp: "Formatted at 2026-08-11 01:00:44 on dist-test-slave-42z9"
server_key: "a32b62b78132506c4317c63fc9b797f7"
server_key_iv: "a95df8f1f6091394dade3926ea4c9157"
server_key_version: "encryptionkey@0"
I20260811 01:00:44.533603 17497 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:44.534464 17524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:44.534658 17497 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:44.534759 17497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "ca494e704cea4946b02d42143853e900"
format_stamp: "Formatted at 2026-08-11 01:00:44 on dist-test-slave-42z9"
server_key: "a32b62b78132506c4317c63fc9b797f7"
server_key_iv: "a95df8f1f6091394dade3926ea4c9157"
server_key_version: "encryptionkey@0"
I20260811 01:00:44.534835 17497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:44.568543 17497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:44.570637 17497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:44.570796 17497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:44.575145 17497 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:36331
I20260811 01:00:44.575186 17613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:36331 every 8 connection(s)
I20260811 01:00:44.575549 17497 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:44.576489 17614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:44.578949 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 17497
I20260811 01:00:44.579053 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:44.579124 17614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900: Bootstrap starting.
I20260811 01:00:44.579209 13434 external_mini_cluster.cc:1428] Setting key 8901489dab187a46693dec15e39dbddd
I20260811 01:00:44.579887 17614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:44.580201 17614 log.cc:824] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:44.580971 17614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900: No bootstrap required, opened a new log
I20260811 01:00:44.583217 17614 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca494e704cea4946b02d42143853e900" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36331 } }
I20260811 01:00:44.583406 17614 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:44.583448 17614 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca494e704cea4946b02d42143853e900, State: Initialized, Role: FOLLOWER
I20260811 01:00:44.583581 17614 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca494e704cea4946b02d42143853e900" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36331 } }
I20260811 01:00:44.583665 17614 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:44.583690 17614 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:44.583737 17614 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:44.584463 17614 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca494e704cea4946b02d42143853e900" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36331 } }
I20260811 01:00:44.584568 17614 leader_election.cc:302] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca494e704cea4946b02d42143853e900; no voters:
I20260811 01:00:44.584764 17614 leader_election.cc:288] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:44.584807 17620 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:44.584964 17620 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [term 1 LEADER]: Becoming Leader. State: Replica: ca494e704cea4946b02d42143853e900, State: Running, Role: LEADER
I20260811 01:00:44.585054 17614 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:44.585063 17620 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca494e704cea4946b02d42143853e900" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36331 } }
I20260811 01:00:44.585426 17624 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca494e704cea4946b02d42143853e900" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca494e704cea4946b02d42143853e900" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36331 } } }
I20260811 01:00:44.585551 17624 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:44.585415 17620 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca494e704cea4946b02d42143853e900. Latest consensus state: current_term: 1 leader_uuid: "ca494e704cea4946b02d42143853e900" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca494e704cea4946b02d42143853e900" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36331 } } }
I20260811 01:00:44.585732 17620 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900 [sys.catalog]: This master's current role is: LEADER
Aug 11 01:00:44 dist-test-slave-42z9 krb5kdc[17475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410044, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:44.586369 17635 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:44.587014 17635 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:44.588644 17635 catalog_manager.cc:1347] Generated new cluster ID: 6cdaf24b1d4540929640f3b3852e6aa7
I20260811 01:00:44.588702 17635 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:44.590523 17617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:44.579779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41894 (local address 127.13.30.190:36331)
0811 01:00:44.579958 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:44.579969 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:44.580003 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:00:44.580519 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:44.580527 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:44.580579 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:44.580697 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:44.581505 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:44.582393 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:44.583477 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:44.584009 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:44.584092 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:44.587058 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:44.587063 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:44.587063 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:44.587076 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:44.588972 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:44.589323 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:44.589326 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:44.589327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:44.589418 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:44.589635 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:44.589636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:44.589636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:44.589887 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:44.590025 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:44.590144 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 01:00:44.590290 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":73,"threads_started":1}
I20260811 01:00:44.598990 17635 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:44.599792 17635 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:44.604478 17635 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca494e704cea4946b02d42143853e900: Generated new TSK 0
I20260811 01:00:44.604699 17635 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:00:44.632488 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:36331
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:36795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:44.719400 17660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:44.719624 17660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:44.719658 17660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:44.720937 17660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:44.720988 17660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:44.721026 17660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:00:44.722676 17660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:36331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:44.722962 17660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:44.723212 17660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:44.729431 17670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:44.729631 17673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:44.729457 17669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:44.729880 17660 server_base.cc:1034] running on GCE node
I20260811 01:00:44.730225 17660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:44.730558 17660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:44.731709 17660 hybrid_clock.cc:648] HybridClock initialized: now 1786410044731697 us; error 30 us; skew 500 ppm
Aug 11 01:00:44 dist-test-slave-42z9 krb5kdc[17475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410044, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:44.734414 17660 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:00:44.734903 17660 webserver.cc:460] Webserver started at http://127.13.30.129:41325/ using document root <none> and password file <none>
I20260811 01:00:44.735149 17660 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:44.735198 17660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:44.735343 17660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:44.736474 17660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "8f6f144ff96c4818a3484b90f9330dc5"
format_stamp: "Formatted at 2026-08-11 01:00:44 on dist-test-slave-42z9"
server_key: "fe82b49040e0e80086fbe7184449e7e0"
server_key_iv: "9280015b27dcce80044f49b107bc899c"
server_key_version: "encryptionkey@0"
I20260811 01:00:44.736817 17660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "8f6f144ff96c4818a3484b90f9330dc5"
format_stamp: "Formatted at 2026-08-11 01:00:44 on dist-test-slave-42z9"
server_key: "fe82b49040e0e80086fbe7184449e7e0"
server_key_iv: "9280015b27dcce80044f49b107bc899c"
server_key_version: "encryptionkey@0"
I20260811 01:00:44.738327 17660 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:44.739161 17684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:44.739327 17660 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:44.739414 17660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "8f6f144ff96c4818a3484b90f9330dc5"
format_stamp: "Formatted at 2026-08-11 01:00:44 on dist-test-slave-42z9"
server_key: "fe82b49040e0e80086fbe7184449e7e0"
server_key_iv: "9280015b27dcce80044f49b107bc899c"
server_key_version: "encryptionkey@0"
I20260811 01:00:44.739503 17660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:44.750587 17660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:44.752816 17660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:44.752961 17660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:44.753216 17660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:44.753576 17660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:44.753614 17660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:44.753636 17660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:44.753660 17660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:44.759581 17660 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:38783
I20260811 01:00:44.759671 17898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:38783 every 8 connection(s)
I20260811 01:00:44.759964 17660 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
Aug 11 01:00:44 dist-test-slave-42z9 krb5kdc[17475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410044, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:44.768930 17617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:44.760693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:38521 (local address 127.13.30.190:36331)
0811 01:00:44.760758 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:44.760761 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:44.760948 (+ 187us) server_negotiation.cc:407] Connection header received
0811 01:00:44.761474 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:44.761475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:44.761488 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:44.761543 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:44.762534 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:44.763051 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:44.764057 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:44.764273 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:44.764331 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:44.766563 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:44.766565 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:44.766565 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:44.766573 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:44.767824 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:44.768175 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:44.768175 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:44.768176 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:44.768224 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:44.768408 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:44.768408 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:44.768409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:44.768511 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:44.768554 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:44.768779 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 01:00:44.768855 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 01:00:44.769100 17903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:44.760663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:36331 (local address 127.13.30.129:38521)
0811 01:00:44.760818 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:44.760855 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:44.761351 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:44.761613 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:44.761616 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:44.762210 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:44.762422 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:44.762427 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:44.763146 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:44.763147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:44.763967 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:44.763969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:44.764349 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:44.764350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:44.764479 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:44.764990 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:44.764999 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:44.766460 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:44.767894 (+ 1434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:44.767899 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:44.767901 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:44.768119 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:44.768267 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:44.768268 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:44.768268 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:44.768360 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:44.768553 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:44.768556 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:44.768679 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 01:00:44.768758 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 01:00:44.768888 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":72,"threads_started":1}
I20260811 01:00:44.769156 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 17660
I20260811 01:00:44.769239 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:00:44.769431 13434 external_mini_cluster.cc:1428] Setting key d4a89eba6acac22aacd1cd326e63cdca
I20260811 01:00:44.769621 17900 heartbeater.cc:347] Connected to a master server at 127.13.30.190:36331
I20260811 01:00:44.769721 17900 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:44.769933 17900 heartbeater.cc:511] Master 127.13.30.190:36331 requested a full tablet report, sending...
I20260811 01:00:44.770462 17553 ts_manager.cc:194] Registered new tserver with Master: 8f6f144ff96c4818a3484b90f9330dc5 (127.13.30.129:38783)
I20260811 01:00:44.771064 17553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:38521
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:00:44.796334 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:36331
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:36795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:44.882802 17909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:44.883057 17909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:44.883095 17909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:44.884339 17909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:44.884387 17909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:44.884426 17909 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:00:44.886091 17909 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:36331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:44.886313 17909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:44.886541 17909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:44.891659 17922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:44.891659 17926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:44.891688 17923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:44.891705 17909 server_base.cc:1034] running on GCE node
I20260811 01:00:44.892048 17909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:44.892269 17909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:44.893486 17909 hybrid_clock.cc:648] HybridClock initialized: now 1786410044893465 us; error 29 us; skew 500 ppm
Aug 11 01:00:44 dist-test-slave-42z9 krb5kdc[17475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410044, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:44.895972 17909 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:00:44.896445 17909 webserver.cc:460] Webserver started at http://127.13.30.130:39135/ using document root <none> and password file <none>
I20260811 01:00:44.896668 17909 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:44.896718 17909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:44.896847 17909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:44.897997 17909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "98257d02cd194c159c12ae3158e0cb93"
format_stamp: "Formatted at 2026-08-11 01:00:44 on dist-test-slave-42z9"
server_key: "bf2265770e94e158bdb1d702ea49545a"
server_key_iv: "b0bbbec07ff50222ecc88e1433aef101"
server_key_version: "encryptionkey@0"
I20260811 01:00:44.898358 17909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "98257d02cd194c159c12ae3158e0cb93"
format_stamp: "Formatted at 2026-08-11 01:00:44 on dist-test-slave-42z9"
server_key: "bf2265770e94e158bdb1d702ea49545a"
server_key_iv: "b0bbbec07ff50222ecc88e1433aef101"
server_key_version: "encryptionkey@0"
I20260811 01:00:44.899708 17909 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:00:44.900414 17937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:44.900590 17909 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:44.900676 17909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "98257d02cd194c159c12ae3158e0cb93"
format_stamp: "Formatted at 2026-08-11 01:00:44 on dist-test-slave-42z9"
server_key: "bf2265770e94e158bdb1d702ea49545a"
server_key_iv: "b0bbbec07ff50222ecc88e1433aef101"
server_key_version: "encryptionkey@0"
I20260811 01:00:44.900739 17909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:44.927496 17909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:44.929936 17909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:44.930099 17909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:44.930371 17909 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:44.930728 17909 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:44.930769 17909 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:44.930800 17909 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:44.930824 17909 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:44.937352 17909 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:41047
I20260811 01:00:44.937409 18139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:41047 every 8 connection(s)
I20260811 01:00:44.937790 17909 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:00:44.942925 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 17909
I20260811 01:00:44.943049 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:00:44.943228 13434 external_mini_cluster.cc:1428] Setting key 95084f5d24becb72979bfd28c0637e70
Aug 11 01:00:44 dist-test-slave-42z9 krb5kdc[17475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410044, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:44.948511 17617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:44.938557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:35889 (local address 127.13.30.190:36331)
0811 01:00:44.938624 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:44.938626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:44.938814 (+ 188us) server_negotiation.cc:407] Connection header received
0811 01:00:44.939341 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:44.939341 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:44.939352 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:44.939399 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:44.940458 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:44.941098 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:44.942297 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:44.942533 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:44.942600 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:44.945203 (+ 2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:44.945205 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:44.945206 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:44.945214 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:44.946627 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:44.947113 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:44.947115 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:44.947115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:44.947177 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:44.947556 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:44.947559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:44.947559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:44.947806 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:44.947921 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:44.948332 (+ 411us) server_negotiation.cc:299] Negotiation successful
0811 01:00:44.948429 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 01:00:44.948776 18143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:44.938521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:36331 (local address 127.13.30.130:35889)
0811 01:00:44.938705 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:44.938746 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:44.939245 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:44.939462 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:44.939465 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:44.940073 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:44.940286 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:44.940292 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:44.941233 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:44.941234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:44.942187 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:44.942192 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:44.942609 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:44.942610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:44.942779 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:44.943406 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:44.943417 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:44.945091 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:44.946717 (+ 1626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:44.946726 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:44.946729 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:44.947022 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:44.947243 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:44.947243 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:44.947244 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:44.947399 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:44.947926 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:44.947935 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:44.948132 (+ 197us) client_negotiation.cc:769] Sending connection context
0811 01:00:44.948281 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 01:00:44.948517 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":103,"threads_started":1}
I20260811 01:00:44.949414 18141 heartbeater.cc:347] Connected to a master server at 127.13.30.190:36331
I20260811 01:00:44.949568 18141 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:44.949783 18141 heartbeater.cc:511] Master 127.13.30.190:36331 requested a full tablet report, sending...
I20260811 01:00:44.950212 17553 ts_manager.cc:194] Registered new tserver with Master: 98257d02cd194c159c12ae3158e0cb93 (127.13.30.130:41047)
I20260811 01:00:44.950767 17553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:35889
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:00:44.972031 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:36331
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:36795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:45.061515 18146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:45.061754 18146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:45.061780 18146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:45.063014 18146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:45.063060 18146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:45.063088 18146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:00:45.064673 18146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:36331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:45.064914 18146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:45.065135 18146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:45.070488 18156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:45.070501 18154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:45.070513 18153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:45.070688 18146 server_base.cc:1034] running on GCE node
I20260811 01:00:45.071019 18146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:45.071296 18146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:45.072445 18146 hybrid_clock.cc:648] HybridClock initialized: now 1786410045072430 us; error 35 us; skew 500 ppm
Aug 11 01:00:45 dist-test-slave-42z9 krb5kdc[17475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410045, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:45.075003 18146 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:00:45.075495 18146 webserver.cc:460] Webserver started at http://127.13.30.131:43787/ using document root <none> and password file <none>
I20260811 01:00:45.075712 18146 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:45.075757 18146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:45.075873 18146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:45.077003 18146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "ef279a276f03422a9f2683c14016554a"
format_stamp: "Formatted at 2026-08-11 01:00:45 on dist-test-slave-42z9"
server_key: "aa7df77c39ee1dc49899087709d790ae"
server_key_iv: "384b2a65770af7236386195aef501f8d"
server_key_version: "encryptionkey@0"
I20260811 01:00:45.077354 18146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "ef279a276f03422a9f2683c14016554a"
format_stamp: "Formatted at 2026-08-11 01:00:45 on dist-test-slave-42z9"
server_key: "aa7df77c39ee1dc49899087709d790ae"
server_key_iv: "384b2a65770af7236386195aef501f8d"
server_key_version: "encryptionkey@0"
I20260811 01:00:45.078795 18146 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:45.079716 18165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:45.080098 18146 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:45.080199 18146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "ef279a276f03422a9f2683c14016554a"
format_stamp: "Formatted at 2026-08-11 01:00:45 on dist-test-slave-42z9"
server_key: "aa7df77c39ee1dc49899087709d790ae"
server_key_iv: "384b2a65770af7236386195aef501f8d"
server_key_version: "encryptionkey@0"
I20260811 01:00:45.080276 18146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:45.098393 18146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:45.100768 18146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:45.100921 18146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:45.101159 18146 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:45.101528 18146 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:45.101569 18146 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:45.101603 18146 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:45.101626 18146 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:45.108028 18146 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:38227
I20260811 01:00:45.108088 18358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:38227 every 8 connection(s)
I20260811 01:00:45.108428 18146 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:00:45.109329 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 18146
I20260811 01:00:45.109429 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:00:45.109628 13434 external_mini_cluster.cc:1428] Setting key 8057dd5613c437eeb2b3225d23fdba84
Aug 11 01:00:45 dist-test-slave-42z9 krb5kdc[17475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410045, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:45.118319 17617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:45.109153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:54043 (local address 127.13.30.190:36331)
0811 01:00:45.109213 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:45.109216 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:45.109465 (+ 249us) server_negotiation.cc:407] Connection header received
0811 01:00:45.110110 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:45.110110 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:45.110122 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:45.110160 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:45.111215 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:45.111731 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:45.112708 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:45.112894 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:45.112939 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:45.115199 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:45.115201 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:45.115201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:45.115209 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:45.116578 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:45.117285 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:45.117286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:45.117286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:45.117345 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:45.117730 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:45.117731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:45.117731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:45.117853 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:45.117908 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:45.118161 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 01:00:45.118245 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 01:00:45.118521 18361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:45.109121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:36331 (local address 127.13.30.131:54043)
0811 01:00:45.109316 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:45.109357 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:45.110013 (+ 656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:45.110228 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:45.110232 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:45.110914 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:45.111128 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:45.111134 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:45.111798 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:45.111799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:45.112635 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:45.112638 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:45.112954 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:45.112955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:45.113063 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:45.113645 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:45.113654 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:45.115081 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:45.116737 (+ 1656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:45.116756 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:45.116760 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:45.117167 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:45.117485 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:45.117488 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:45.117488 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:45.117668 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:45.117906 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:45.117911 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:45.118050 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 01:00:45.118133 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 01:00:45.118293 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":93,"threads_started":1}
I20260811 01:00:45.119015 18359 heartbeater.cc:347] Connected to a master server at 127.13.30.190:36331
I20260811 01:00:45.119129 18359 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:45.119344 18359 heartbeater.cc:511] Master 127.13.30.190:36331 requested a full tablet report, sending...
I20260811 01:00:45.119712 17553 ts_manager.cc:194] Registered new tserver with Master: ef279a276f03422a9f2683c14016554a (127.13.30.131:38227)
I20260811 01:00:45.120090 17553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:54043
I20260811 01:00:45.121431 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 01:00:45.135910 17617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:45.134802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41900 (local address 127.13.30.190:36331)
0811 01:00:45.134870 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:45.134873 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:45.135003 (+ 130us) server_negotiation.cc:407] Connection header received
0811 01:00:45.135085 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:45.135086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:45.135098 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:45.135146 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:45.135813 (+ 667us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41900: BlockingRecv error: recv got EOF from 127.0.0.1:41900 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 01:00:45.136814 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 17660
I20260811 01:00:45.157176 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 17909
I20260811 01:00:45.184916 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 18146
I20260811 01:00:45.208179 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 17497
2026-08-11T01:00:45Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2104 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:45 dist-test-slave-42z9 krb5kdc[18373](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:45 dist-test-slave-42z9 krb5kdc[18373](info): set up 2 sockets
Aug 11 01:00:45 dist-test-slave-42z9 krb5kdc[18373](info): commencing operation
krb5kdc: starting...
W20260811 01:00:46.404452 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:00:46 dist-test-slave-42z9 krb5kdc[18373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:00:46.532663 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:46781
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:43323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:46781
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:46.619254 18391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:46.619519 18391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:46.619565 18391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:46.620808 18391 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:46.620857 18391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:46.620875 18391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:46.620891 18391 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:46.620906 18391 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:46.622552 18391 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:43323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:46781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:46781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:46.622845 18391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:46.623072 18391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:46.628185 18403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:46.628201 18406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:46.628257 18391 server_base.cc:1034] running on GCE node
W20260811 01:00:46.628333 18401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:46.628741 18391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:46.629041 18391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:46.630182 18391 hybrid_clock.cc:648] HybridClock initialized: now 1786410046630163 us; error 37 us; skew 500 ppm
Aug 11 01:00:46 dist-test-slave-42z9 krb5kdc[18373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410046, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:46.632656 18391 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:00:46.633109 18391 webserver.cc:460] Webserver started at http://127.13.30.190:33113/ using document root <none> and password file <none>
I20260811 01:00:46.633348 18391 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:46.633412 18391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:46.633572 18391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:46.634656 18391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "e85b3be7236741d6bb60d1aef0ddb52c"
format_stamp: "Formatted at 2026-08-11 01:00:46 on dist-test-slave-42z9"
server_key: "3d874ce5e95d2164fe5f46dfc8a5c356"
server_key_iv: "f95d2594428274cad3fc6047e0b1177b"
server_key_version: "encryptionkey@0"
I20260811 01:00:46.635002 18391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "e85b3be7236741d6bb60d1aef0ddb52c"
format_stamp: "Formatted at 2026-08-11 01:00:46 on dist-test-slave-42z9"
server_key: "3d874ce5e95d2164fe5f46dfc8a5c356"
server_key_iv: "f95d2594428274cad3fc6047e0b1177b"
server_key_version: "encryptionkey@0"
I20260811 01:00:46.636312 18391 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:46.636956 18416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:46.637105 18391 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:46.637202 18391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "e85b3be7236741d6bb60d1aef0ddb52c"
format_stamp: "Formatted at 2026-08-11 01:00:46 on dist-test-slave-42z9"
server_key: "3d874ce5e95d2164fe5f46dfc8a5c356"
server_key_iv: "f95d2594428274cad3fc6047e0b1177b"
server_key_version: "encryptionkey@0"
I20260811 01:00:46.637267 18391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:46.648478 18391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:46.650580 18391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:46.650712 18391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:46.654875 18391 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:46781
I20260811 01:00:46.654917 18505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:46781 every 8 connection(s)
I20260811 01:00:46.655454 18391 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:46.656132 18507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:46.658636 18507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c: Bootstrap starting.
I20260811 01:00:46.658810 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 18391
I20260811 01:00:46.658895 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:46.659065 13434 external_mini_cluster.cc:1428] Setting key 17ad66cfc3770b4ed4756cf5e28fe97c
I20260811 01:00:46.659369 18507 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:46.659746 18507 log.cc:824] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:46.660532 18507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c: No bootstrap required, opened a new log
I20260811 01:00:46.662966 18507 raft_consensus.cc:348] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e85b3be7236741d6bb60d1aef0ddb52c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46781 } }
I20260811 01:00:46.663112 18507 raft_consensus.cc:374] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:46.663136 18507 raft_consensus.cc:729] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e85b3be7236741d6bb60d1aef0ddb52c, State: Initialized, Role: FOLLOWER
I20260811 01:00:46.663254 18507 consensus_queue.cc:260] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e85b3be7236741d6bb60d1aef0ddb52c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46781 } }
I20260811 01:00:46.663328 18507 raft_consensus.cc:388] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:46.663365 18507 raft_consensus.cc:482] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:46.663409 18507 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:46.664036 18507 raft_consensus.cc:504] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e85b3be7236741d6bb60d1aef0ddb52c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46781 } }
I20260811 01:00:46.664146 18507 leader_election.cc:302] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e85b3be7236741d6bb60d1aef0ddb52c; no voters:
I20260811 01:00:46.664325 18507 leader_election.cc:288] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:46.664374 18515 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:46.664494 18515 raft_consensus.cc:686] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [term 1 LEADER]: Becoming Leader. State: Replica: e85b3be7236741d6bb60d1aef0ddb52c, State: Running, Role: LEADER
I20260811 01:00:46.664582 18515 consensus_queue.cc:237] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e85b3be7236741d6bb60d1aef0ddb52c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46781 } }
I20260811 01:00:46.664631 18507 sys_catalog.cc:564] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:46.664901 18515 sys_catalog.cc:455] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e85b3be7236741d6bb60d1aef0ddb52c. Latest consensus state: current_term: 1 leader_uuid: "e85b3be7236741d6bb60d1aef0ddb52c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e85b3be7236741d6bb60d1aef0ddb52c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46781 } } }
I20260811 01:00:46.664973 18515 sys_catalog.cc:458] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:46.666210 18516 sys_catalog.cc:455] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e85b3be7236741d6bb60d1aef0ddb52c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e85b3be7236741d6bb60d1aef0ddb52c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46781 } } }
I20260811 01:00:46.666296 18516 sys_catalog.cc:458] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c [sys.catalog]: This master's current role is: LEADER
Aug 11 01:00:46 dist-test-slave-42z9 krb5kdc[18373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
W20260811 01:00:46.666559 18541 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:00:46.666611 18541 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:00:46.666667 18521 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:46.666891 18521 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:46.668497 18521 catalog_manager.cc:1347] Generated new cluster ID: 88351b4293f54e82aab2c4d0afec8a8b
I20260811 01:00:46.668582 18521 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:46.670692 18511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:46.659593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50886 (local address 127.13.30.190:46781)
0811 01:00:46.659790 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:46.659799 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:46.659834 (+ 35us) server_negotiation.cc:407] Connection header received
0811 01:00:46.660403 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:46.660413 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:46.660499 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:46.660650 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:46.661272 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:46.662713 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:46.663535 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:46.663958 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:46.664062 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:46.667086 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:46.667091 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:46.667091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:46.667102 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:46.669119 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:46.669521 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:46.669524 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:46.669524 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:46.669637 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:46.669806 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:46.669807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:46.669807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:46.670123 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:46.670262 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:46.670333 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 01:00:46.670479 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":78,"threads_started":1}
I20260811 01:00:46.671597 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:46.678283 18521 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:46.679066 18521 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:46.683653 18521 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e85b3be7236741d6bb60d1aef0ddb52c: Generated new TSK 0
I20260811 01:00:46.683841 18521 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:00:46.687212 18511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:46.683002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50890 (local address 127.13.30.190:46781)
0811 01:00:46.683069 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:46.683071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:46.683164 (+ 93us) server_negotiation.cc:407] Connection header received
0811 01:00:46.683226 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:46.683228 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:46.683241 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:46.683294 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:46.683817 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:46.684611 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:46.685796 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:46.686026 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:46.686093 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:46.686785 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:46.686786 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:46.686787 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:46.686981 (+ 194us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:46.686998 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:46.687004 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:46.687049 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:46.687123 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 01:00:46.687149 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 01:00:46.689756 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 18391
2026-08-11T01:00:46Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1486 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:46 dist-test-slave-42z9 krb5kdc[18556](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:46 dist-test-slave-42z9 krb5kdc[18556](info): set up 2 sockets
Aug 11 01:00:46 dist-test-slave-42z9 krb5kdc[18556](info): commencing operation
krb5kdc: starting...
W20260811 01:00:47.878137 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:00:47 dist-test-slave-42z9 krb5kdc[18556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:00:48.006577 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:41485
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:41485
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:48.093135 18585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:48.093374 18585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:48.093400 18585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:48.094687 18585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:48.094740 18585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:48.094753 18585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:48.094765 18585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:48.094776 18585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:48.096362 18585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:41485
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:41485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:48.096599 18585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:48.096799 18585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:48.101799 18594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:48.101799 18593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:48.101794 18596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:48.102088 18585 server_base.cc:1034] running on GCE node
I20260811 01:00:48.102355 18585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:48.102682 18585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:48.103837 18585 hybrid_clock.cc:648] HybridClock initialized: now 1786410048103816 us; error 35 us; skew 500 ppm
Aug 11 01:00:48 dist-test-slave-42z9 krb5kdc[18556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410048, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:48.106433 18585 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:00:48.106928 18585 webserver.cc:460] Webserver started at http://127.13.30.190:41963/ using document root <none> and password file <none>
I20260811 01:00:48.107151 18585 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:48.107198 18585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:48.107331 18585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:48.108425 18585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "8b580a99d0564a23a8b197da1ab5179e"
format_stamp: "Formatted at 2026-08-11 01:00:48 on dist-test-slave-42z9"
server_key: "5a3bee53c38871160c0b6bf0900df0d2"
server_key_iv: "f329194f5396a0bc010fef02623e2929"
server_key_version: "encryptionkey@0"
I20260811 01:00:48.108777 18585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "8b580a99d0564a23a8b197da1ab5179e"
format_stamp: "Formatted at 2026-08-11 01:00:48 on dist-test-slave-42z9"
server_key: "5a3bee53c38871160c0b6bf0900df0d2"
server_key_iv: "f329194f5396a0bc010fef02623e2929"
server_key_version: "encryptionkey@0"
I20260811 01:00:48.110214 18585 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:48.110918 18613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:48.111065 18585 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:48.111152 18585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "8b580a99d0564a23a8b197da1ab5179e"
format_stamp: "Formatted at 2026-08-11 01:00:48 on dist-test-slave-42z9"
server_key: "5a3bee53c38871160c0b6bf0900df0d2"
server_key_iv: "f329194f5396a0bc010fef02623e2929"
server_key_version: "encryptionkey@0"
I20260811 01:00:48.111215 18585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:48.130182 18585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:48.132055 18585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:48.132201 18585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:48.136534 18585 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:41485
I20260811 01:00:48.136605 18703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:41485 every 8 connection(s)
I20260811 01:00:48.137081 18585 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:48.138278 18704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:48.140774 18704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e: Bootstrap starting.
I20260811 01:00:48.141410 18704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:48.141742 18704 log.cc:824] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:48.142577 18704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e: No bootstrap required, opened a new log
I20260811 01:00:48.143221 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 18585
I20260811 01:00:48.143312 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:48.143472 13434 external_mini_cluster.cc:1428] Setting key 7011c479e9a25b3c262141daba27daf8
I20260811 01:00:48.144682 18704 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b580a99d0564a23a8b197da1ab5179e" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41485 } }
I20260811 01:00:48.144871 18704 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:48.144909 18704 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b580a99d0564a23a8b197da1ab5179e, State: Initialized, Role: FOLLOWER
I20260811 01:00:48.145063 18704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b580a99d0564a23a8b197da1ab5179e" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41485 } }
I20260811 01:00:48.145140 18704 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:48.145162 18704 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:48.145210 18704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:48.146416 18704 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b580a99d0564a23a8b197da1ab5179e" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41485 } }
I20260811 01:00:48.146544 18704 leader_election.cc:302] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b580a99d0564a23a8b197da1ab5179e; no voters:
I20260811 01:00:48.146705 18704 leader_election.cc:288] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:48.146750 18710 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:48.146896 18710 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [term 1 LEADER]: Becoming Leader. State: Replica: 8b580a99d0564a23a8b197da1ab5179e, State: Running, Role: LEADER
I20260811 01:00:48.146965 18704 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:48.147008 18710 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b580a99d0564a23a8b197da1ab5179e" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41485 } }
I20260811 01:00:48.147403 18711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b580a99d0564a23a8b197da1ab5179e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b580a99d0564a23a8b197da1ab5179e" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41485 } } }
I20260811 01:00:48.147543 18711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:48.147400 18714 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b580a99d0564a23a8b197da1ab5179e. Latest consensus state: current_term: 1 leader_uuid: "8b580a99d0564a23a8b197da1ab5179e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b580a99d0564a23a8b197da1ab5179e" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41485 } } }
I20260811 01:00:48.147606 18714 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:48.147766 18727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:48.148417 18727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:48.150250 18727 catalog_manager.cc:1347] Generated new cluster ID: 8fc646cb93e04d278734f468af6605cb
I20260811 01:00:48.150306 18727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 01:00:48 dist-test-slave-42z9 krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:48.155565 18709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:48.144019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40204 (local address 127.13.30.190:41485)
0811 01:00:48.144241 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:48.144252 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:48.144291 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:00:48.144646 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:48.144655 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:48.144731 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:48.144887 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:48.145648 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.147018 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.148123 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.148806 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.148915 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:48.151784 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:48.151789 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:48.151790 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:48.151803 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:48.153823 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:48.154231 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:48.154234 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:48.154234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:48.154371 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:48.154555 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:48.154556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:48.154557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:48.154894 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:48.155079 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:48.155155 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 01:00:48.155318 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":98,"threads_started":1}
I20260811 01:00:48.164541 18727 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:48.165071 18727 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:48.176045 18727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b580a99d0564a23a8b197da1ab5179e: Generated new TSK 0
I20260811 01:00:48.176242 18727 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:00:48.210711 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41485
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:48.310364 18748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:48.310595 18748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:48.310631 18748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:48.311826 18748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:48.311873 18748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:48.311908 18748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:00:48.313427 18748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41485
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:48.313753 18748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:48.313979 18748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:48.319797 18769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:48.319818 18766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:48.319846 18767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:48.319980 18748 server_base.cc:1034] running on GCE node
I20260811 01:00:48.320305 18748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:48.320583 18748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:48.321725 18748 hybrid_clock.cc:648] HybridClock initialized: now 1786410048321711 us; error 31 us; skew 500 ppm
Aug 11 01:00:48 dist-test-slave-42z9 krb5kdc[18556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410048, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:48.324380 18748 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:00:48.324901 18748 webserver.cc:460] Webserver started at http://127.13.30.129:39897/ using document root <none> and password file <none>
I20260811 01:00:48.325131 18748 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:48.325181 18748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:48.325305 18748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:48.326462 18748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "a2f15750a94949d6809beec73d12fd5d"
format_stamp: "Formatted at 2026-08-11 01:00:48 on dist-test-slave-42z9"
server_key: "5caeecb3a9d6aef85b541c823b468f11"
server_key_iv: "55ab91aad0e2f263d0b70c3471714bf6"
server_key_version: "encryptionkey@0"
I20260811 01:00:48.326802 18748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "a2f15750a94949d6809beec73d12fd5d"
format_stamp: "Formatted at 2026-08-11 01:00:48 on dist-test-slave-42z9"
server_key: "5caeecb3a9d6aef85b541c823b468f11"
server_key_iv: "55ab91aad0e2f263d0b70c3471714bf6"
server_key_version: "encryptionkey@0"
I20260811 01:00:48.328047 18748 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:00:48.328742 18780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:48.328907 18748 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:48.329002 18748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "a2f15750a94949d6809beec73d12fd5d"
format_stamp: "Formatted at 2026-08-11 01:00:48 on dist-test-slave-42z9"
server_key: "5caeecb3a9d6aef85b541c823b468f11"
server_key_iv: "55ab91aad0e2f263d0b70c3471714bf6"
server_key_version: "encryptionkey@0"
I20260811 01:00:48.329077 18748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:48.353852 18748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:48.356082 18748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:48.356227 18748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:48.356465 18748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:48.356786 18748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:48.356823 18748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:48.356854 18748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:48.356879 18748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:48.363169 18748 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:38735
I20260811 01:00:48.363225 18960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:38735 every 8 connection(s)
I20260811 01:00:48.363569 18748 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:00:48.369649 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 18748
I20260811 01:00:48.369760 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:00:48.369988 13434 external_mini_cluster.cc:1428] Setting key 7684c69983fc84d2717e36a8116ca53b
Aug 11 01:00:48 dist-test-slave-42z9 krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410048, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:48.374231 18709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:48.364326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:34853 (local address 127.13.30.190:41485)
0811 01:00:48.364384 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:48.364386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:48.364574 (+ 188us) server_negotiation.cc:407] Connection header received
0811 01:00:48.365136 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:48.365138 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:48.365153 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:48.365212 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:48.366264 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.366781 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.367799 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.368017 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.368078 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:48.370533 (+ 2455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:48.370534 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:48.370535 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:48.370546 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:48.372138 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:48.372830 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:48.372832 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:48.372832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:48.372906 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:48.373198 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:48.373199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:48.373200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:48.373361 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:48.373432 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:48.374020 (+ 588us) server_negotiation.cc:299] Negotiation successful
0811 01:00:48.374148 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 01:00:48.374518 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:48.364289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41485 (local address 127.13.30.129:34853)
0811 01:00:48.364447 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:48.364488 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:48.365015 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:48.365290 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:48.365294 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:48.365936 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:48.366156 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:48.366162 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.366873 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.366874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:48.367707 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:48.367709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.368095 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.368096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:48.368238 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:48.368755 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:48.368763 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:48.370435 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:48.372339 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:48.372359 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:48.372363 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:48.372737 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:48.372969 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:48.372970 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:48.372970 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:48.373132 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:48.373426 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:48.373435 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:48.373680 (+ 245us) client_negotiation.cc:769] Sending connection context
0811 01:00:48.373941 (+ 261us) client_negotiation.cc:240] Negotiation successful
0811 01:00:48.374216 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":75,"threads_started":1}
I20260811 01:00:48.375273 18963 heartbeater.cc:347] Connected to a master server at 127.13.30.190:41485
I20260811 01:00:48.375427 18963 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:48.375699 18963 heartbeater.cc:511] Master 127.13.30.190:41485 requested a full tablet report, sending...
I20260811 01:00:48.376253 18645 ts_manager.cc:194] Registered new tserver with Master: a2f15750a94949d6809beec73d12fd5d (127.13.30.129:38735)
I20260811 01:00:48.376883 18645 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:34853
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:00:48.398020 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41485
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:48.483520 18972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:48.483736 18972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:48.483760 18972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:48.484933 18972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:48.484972 18972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:48.484997 18972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:00:48.486635 18972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41485
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:48.486860 18972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:48.487063 18972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:48.492007 18992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:48.492046 18988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:48.492079 18985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:48.492240 18972 server_base.cc:1034] running on GCE node
I20260811 01:00:48.492442 18972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:48.492694 18972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:48.493836 18972 hybrid_clock.cc:648] HybridClock initialized: now 1786410048493820 us; error 29 us; skew 500 ppm
Aug 11 01:00:48 dist-test-slave-42z9 krb5kdc[18556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410048, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:48.496361 18972 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:00:48.496872 18972 webserver.cc:460] Webserver started at http://127.13.30.130:34555/ using document root <none> and password file <none>
I20260811 01:00:48.497090 18972 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:48.497131 18972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:48.497224 18972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:48.498312 18972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "016ca01e83c84f5c8e9aba90919c089b"
format_stamp: "Formatted at 2026-08-11 01:00:48 on dist-test-slave-42z9"
server_key: "41e77f30b85085ee2f0e8eb33346c445"
server_key_iv: "a12054ef091edaeb3e2575f050c78b50"
server_key_version: "encryptionkey@0"
I20260811 01:00:48.498675 18972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "016ca01e83c84f5c8e9aba90919c089b"
format_stamp: "Formatted at 2026-08-11 01:00:48 on dist-test-slave-42z9"
server_key: "41e77f30b85085ee2f0e8eb33346c445"
server_key_iv: "a12054ef091edaeb3e2575f050c78b50"
server_key_version: "encryptionkey@0"
I20260811 01:00:48.500139 18972 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 01:00:48.500833 19003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:48.500978 18972 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 01:00:48.501065 18972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "016ca01e83c84f5c8e9aba90919c089b"
format_stamp: "Formatted at 2026-08-11 01:00:48 on dist-test-slave-42z9"
server_key: "41e77f30b85085ee2f0e8eb33346c445"
server_key_iv: "a12054ef091edaeb3e2575f050c78b50"
server_key_version: "encryptionkey@0"
I20260811 01:00:48.501128 18972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:48.513859 18972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:48.516144 18972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:48.516296 18972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:48.516541 18972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:48.516978 18972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:48.517019 18972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:48.517050 18972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:48.517068 18972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:48.523314 18972 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:44867
I20260811 01:00:48.523378 19205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:44867 every 8 connection(s)
I20260811 01:00:48.523716 18972 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:00:48.523984 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 18972
I20260811 01:00:48.524091 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:00:48.524315 13434 external_mini_cluster.cc:1428] Setting key 6bcd551a927aafc40524a499196cee6f
Aug 11 01:00:48 dist-test-slave-42z9 krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410048, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:48.534060 18709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:48.524717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:41773 (local address 127.13.30.190:41485)
0811 01:00:48.524765 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:48.524767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:48.524970 (+ 203us) server_negotiation.cc:407] Connection header received
0811 01:00:48.525558 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:48.525560 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:48.525573 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:48.525622 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:48.526735 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.527251 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.528280 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.528535 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.528604 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:48.531104 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:48.531106 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:48.531106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:48.531115 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:48.532621 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:48.533061 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:48.533062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:48.533063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:48.533131 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:48.533360 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:48.533360 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:48.533361 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:48.533532 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:48.533607 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:48.533851 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 01:00:48.533948 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 01:00:48.534144 19211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:48.524622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41485 (local address 127.13.30.130:41773)
0811 01:00:48.524842 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:48.524896 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:48.525435 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:48.525698 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:48.525703 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:48.526330 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:48.526607 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:48.526613 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.527346 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.527347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:48.528185 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:48.528188 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.528631 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.528632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:48.528773 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:48.529316 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:48.529328 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:48.530993 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:48.532733 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:48.532743 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:48.532746 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:48.532982 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:48.533198 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:48.533199 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:48.533199 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:48.533297 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:48.533592 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:48.533597 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:48.533725 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 01:00:48.533811 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 01:00:48.533953 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":78,"threads_started":1}
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
I20260811 01:00:48.534624 19206 heartbeater.cc:347] Connected to a master server at 127.13.30.190:41485
I20260811 01:00:48.534745 19206 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:48.534931 19206 heartbeater.cc:511] Master 127.13.30.190:41485 requested a full tablet report, sending...
I20260811 01:00:48.535281 18645 ts_manager.cc:194] Registered new tserver with Master: 016ca01e83c84f5c8e9aba90919c089b (127.13.30.130:44867)
I20260811 01:00:48.535667 18645 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:41773
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:00:48.552634 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41485
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:48.637530 19216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:48.637756 19216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:48.637782 19216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:48.639081 19216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:48.639130 19216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:48.639163 19216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:00:48.640792 19216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41485
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:48.641072 19216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:48.641305 19216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:48.646747 19235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:48.646818 19231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:48.647010 19216 server_base.cc:1034] running on GCE node
W20260811 01:00:48.646759 19228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:48.647301 19216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:48.647593 19216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:48.648752 19216 hybrid_clock.cc:648] HybridClock initialized: now 1786410048648738 us; error 33 us; skew 500 ppm
Aug 11 01:00:48 dist-test-slave-42z9 krb5kdc[18556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410048, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:48.651286 19216 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:00:48.651737 19216 webserver.cc:460] Webserver started at http://127.13.30.131:35801/ using document root <none> and password file <none>
I20260811 01:00:48.651947 19216 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:48.652000 19216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:48.652135 19216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:48.653228 19216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "3a6cd78403524bcdbd186cfec04f5084"
format_stamp: "Formatted at 2026-08-11 01:00:48 on dist-test-slave-42z9"
server_key: "bda3d4d5f427fc3f323436af8d6557db"
server_key_iv: "dc060c4c59b77765fc80dc04824b65ed"
server_key_version: "encryptionkey@0"
I20260811 01:00:48.653602 19216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "3a6cd78403524bcdbd186cfec04f5084"
format_stamp: "Formatted at 2026-08-11 01:00:48 on dist-test-slave-42z9"
server_key: "bda3d4d5f427fc3f323436af8d6557db"
server_key_iv: "dc060c4c59b77765fc80dc04824b65ed"
server_key_version: "encryptionkey@0"
I20260811 01:00:48.654958 19216 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:48.655704 19245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:48.655860 19216 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 01:00:48.655946 19216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "3a6cd78403524bcdbd186cfec04f5084"
format_stamp: "Formatted at 2026-08-11 01:00:48 on dist-test-slave-42z9"
server_key: "bda3d4d5f427fc3f323436af8d6557db"
server_key_iv: "dc060c4c59b77765fc80dc04824b65ed"
server_key_version: "encryptionkey@0"
I20260811 01:00:48.656024 19216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:48.669878 19216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:48.672132 19216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:48.672276 19216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:48.672523 19216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:48.672866 19216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:48.672902 19216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:48.672932 19216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:48.672957 19216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:48.679358 19216 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:46647
I20260811 01:00:48.679422 19425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:46647 every 8 connection(s)
I20260811 01:00:48.679744 19216 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
Aug 11 01:00:48 dist-test-slave-42z9 krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410048, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:48.688967 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 19216
I20260811 01:00:48.689080 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:00:48.689270 13434 external_mini_cluster.cc:1428] Setting key 9789feffde0dd615181e1c85a74f7df1
I20260811 01:00:48.689615 18709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:48.680465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:48841 (local address 127.13.30.190:41485)
0811 01:00:48.680510 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:48.680512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:48.680732 (+ 220us) server_negotiation.cc:407] Connection header received
0811 01:00:48.681267 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:48.681268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:48.681289 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:48.681341 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:48.682394 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.682892 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.683898 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.684085 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.684141 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:48.686437 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:48.686438 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:48.686438 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:48.686447 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:48.687719 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:48.688107 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:48.688108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:48.688108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:48.688161 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:48.688725 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:48.688726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:48.688726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:48.688852 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:48.688915 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:48.689381 (+ 466us) server_negotiation.cc:299] Negotiation successful
0811 01:00:48.689515 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 01:00:48.689858 19428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:48.680432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41485 (local address 127.13.30.131:48841)
0811 01:00:48.680606 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:48.680644 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:48.681164 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:48.681414 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:48.681419 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:48.682071 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:48.682284 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:48.682291 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.682978 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.682979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:48.683808 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:48.683810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.684159 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.684160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:48.684292 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:48.684779 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:48.684796 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:48.686321 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:48.687802 (+ 1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:48.687809 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:48.687812 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:48.688041 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:48.688304 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:48.688306 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:48.688306 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:48.688615 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:48.688968 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:48.688980 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:48.689187 (+ 207us) client_negotiation.cc:769] Sending connection context
0811 01:00:48.689356 (+ 169us) client_negotiation.cc:240] Negotiation successful
0811 01:00:48.689594 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":90,"threads_started":1}
I20260811 01:00:48.690387 19426 heartbeater.cc:347] Connected to a master server at 127.13.30.190:41485
I20260811 01:00:48.690500 19426 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:48.690689 19426 heartbeater.cc:511] Master 127.13.30.190:41485 requested a full tablet report, sending...
I20260811 01:00:48.691040 18645 ts_manager.cc:194] Registered new tserver with Master: 3a6cd78403524bcdbd186cfec04f5084 (127.13.30.131:46647)
I20260811 01:00:48.691412 18645 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:48841
I20260811 01:00:48.701730 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:00:48 dist-test-slave-42z9 krb5kdc[18556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410048, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 01:00:48 dist-test-slave-42z9 krb5kdc[18556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410048, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:48.726374 18709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:48.719366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40216 (local address 127.13.30.190:41485)
0811 01:00:48.719454 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:48.719456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:48.719550 (+ 94us) server_negotiation.cc:407] Connection header received
0811 01:00:48.719601 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:48.719602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:48.719612 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:48.719667 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:48.720221 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.720745 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.721462 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:48.721678 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:48.721729 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:48.723963 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:48.723964 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:48.723964 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:48.723973 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:48.725304 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:48.725665 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:48.725666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:48.725666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:48.725721 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:48.725880 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:48.725881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:48.725881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:48.726052 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:48.726131 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:48.726211 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 01:00:48.726283 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 01:00:48.726653 18645 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:40216
I20260811 01:00:48.727322 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 18748
I20260811 01:00:48.754468 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 18972
I20260811 01:00:48.774322 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 19216
I20260811 01:00:48.792742 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 18585
2026-08-11T01:00:48Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2098 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:48 dist-test-slave-42z9 krb5kdc[19448](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:48 dist-test-slave-42z9 krb5kdc[19448](info): set up 2 sockets
Aug 11 01:00:48 dist-test-slave-42z9 krb5kdc[19448](info): commencing operation
krb5kdc: starting...
W20260811 01:00:49.975029 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[19448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:00:50.100255 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:34357
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:34357
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:50.187543 19471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:50.187794 19471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:50.187829 19471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:50.189090 19471 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:50.189141 19471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:50.189159 19471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:50.189175 19471 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:50.189189 19471 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:50.190963 19471 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:34357
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:34357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:50.191264 19471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:50.191502 19471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:50.196550 19482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:50.196569 19479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:50.196576 19480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:50.196858 19471 server_base.cc:1034] running on GCE node
I20260811 01:00:50.197120 19471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:50.197422 19471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:50.198607 19471 hybrid_clock.cc:648] HybridClock initialized: now 1786410050198585 us; error 37 us; skew 500 ppm
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[19448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410050, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:50.207499 19471 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:00:50.208027 19471 webserver.cc:460] Webserver started at http://127.13.30.190:35539/ using document root <none> and password file <none>
I20260811 01:00:50.208228 19471 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:50.208268 19471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:50.208374 19471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:50.209543 19471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "f84ef714f3814c49a86de284c7ea74f6"
format_stamp: "Formatted at 2026-08-11 01:00:50 on dist-test-slave-42z9"
server_key: "1c78e9fde5d777581ed3d7bec0f442cc"
server_key_iv: "a39ca9170672f4e8887eb38404e1f5bd"
server_key_version: "encryptionkey@0"
I20260811 01:00:50.209898 19471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "f84ef714f3814c49a86de284c7ea74f6"
format_stamp: "Formatted at 2026-08-11 01:00:50 on dist-test-slave-42z9"
server_key: "1c78e9fde5d777581ed3d7bec0f442cc"
server_key_iv: "a39ca9170672f4e8887eb38404e1f5bd"
server_key_version: "encryptionkey@0"
I20260811 01:00:50.211237 19471 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:50.211964 19493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:50.212144 19471 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 01:00:50.212230 19471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "f84ef714f3814c49a86de284c7ea74f6"
format_stamp: "Formatted at 2026-08-11 01:00:50 on dist-test-slave-42z9"
server_key: "1c78e9fde5d777581ed3d7bec0f442cc"
server_key_iv: "a39ca9170672f4e8887eb38404e1f5bd"
server_key_version: "encryptionkey@0"
I20260811 01:00:50.212311 19471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:50.240743 19471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:50.242923 19471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:50.243067 19471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:50.247304 19471 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:34357
I20260811 01:00:50.247337 19579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:34357 every 8 connection(s)
I20260811 01:00:50.247880 19471 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:50.248636 19580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:50.251130 19580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6: Bootstrap starting.
I20260811 01:00:50.251762 19580 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:50.252020 19580 log.cc:824] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:50.252774 19580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6: No bootstrap required, opened a new log
I20260811 01:00:50.254515 19580 raft_consensus.cc:348] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f84ef714f3814c49a86de284c7ea74f6" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34357 } }
I20260811 01:00:50.254683 19580 raft_consensus.cc:374] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:50.254706 19580 raft_consensus.cc:729] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f84ef714f3814c49a86de284c7ea74f6, State: Initialized, Role: FOLLOWER
I20260811 01:00:50.254828 19580 consensus_queue.cc:260] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f84ef714f3814c49a86de284c7ea74f6" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34357 } }
I20260811 01:00:50.254906 19580 raft_consensus.cc:388] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:50.254936 19580 raft_consensus.cc:482] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:50.254971 19580 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:50.255923 19580 raft_consensus.cc:504] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f84ef714f3814c49a86de284c7ea74f6" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34357 } }
I20260811 01:00:50.256026 19580 leader_election.cc:302] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f84ef714f3814c49a86de284c7ea74f6; no voters:
I20260811 01:00:50.256173 19580 leader_election.cc:288] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:50.256245 19583 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:50.256429 19583 raft_consensus.cc:686] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [term 1 LEADER]: Becoming Leader. State: Replica: f84ef714f3814c49a86de284c7ea74f6, State: Running, Role: LEADER
I20260811 01:00:50.256467 19580 sys_catalog.cc:564] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:50.256536 19583 consensus_queue.cc:237] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f84ef714f3814c49a86de284c7ea74f6" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34357 } }
I20260811 01:00:50.256631 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 19471
I20260811 01:00:50.256752 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:50.256940 13434 external_mini_cluster.cc:1428] Setting key 3652c3d7cffd5d7234f9fd94eade68e6
I20260811 01:00:50.256912 19589 sys_catalog.cc:455] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f84ef714f3814c49a86de284c7ea74f6. Latest consensus state: current_term: 1 leader_uuid: "f84ef714f3814c49a86de284c7ea74f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f84ef714f3814c49a86de284c7ea74f6" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34357 } } }
I20260811 01:00:50.256991 19589 sys_catalog.cc:458] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:50.257143 19587 sys_catalog.cc:455] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f84ef714f3814c49a86de284c7ea74f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f84ef714f3814c49a86de284c7ea74f6" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34357 } } }
I20260811 01:00:50.257200 19587 sys_catalog.cc:458] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:50.257563 19600 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:50.258141 19600 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:50.259564 19600 catalog_manager.cc:1347] Generated new cluster ID: f55b954cfda641479742d7625acf7494
I20260811 01:00:50.259615 19600 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[19448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:50.269158 19608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:50.257549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43832 (local address 127.13.30.190:34357)
0811 01:00:50.257919 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:50.257931 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:50.257966 (+ 35us) server_negotiation.cc:407] Connection header received
0811 01:00:50.258107 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:50.258115 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:50.258177 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:50.259110 (+ 933us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:50.259210 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.260592 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.261719 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.262440 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.262567 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:50.265408 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:50.265412 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:50.265413 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:50.265426 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:50.267418 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:50.267861 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:50.267864 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:50.267864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:50.267973 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:50.268171 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:50.268172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:50.268172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:50.268489 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:50.268636 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:50.268763 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 01:00:50.268908 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":88,"threads_started":1}
I20260811 01:00:50.274040 19600 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:50.274597 19600 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:50.277943 19600 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f84ef714f3814c49a86de284c7ea74f6: Generated new TSK 0
I20260811 01:00:50.278146 19600 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:00:50.311908 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34357
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:50.423516 19621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:50.423784 19621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:50.423811 19621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:50.425153 19621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:50.425209 19621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:50.425243 19621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:00:50.427007 19621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:50.427307 19621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:50.427556 19621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:50.433013 19626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:50.433025 19629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:50.432984 19637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:50.433259 19621 server_base.cc:1034] running on GCE node
I20260811 01:00:50.433535 19621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:50.433786 19621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:50.434948 19621 hybrid_clock.cc:648] HybridClock initialized: now 1786410050434931 us; error 26 us; skew 500 ppm
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[19448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410050, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:50.437613 19621 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:00:50.438064 19621 webserver.cc:460] Webserver started at http://127.13.30.129:41505/ using document root <none> and password file <none>
I20260811 01:00:50.438292 19621 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:50.438351 19621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:50.438488 19621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:50.439589 19621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "229ebbbd62cd4ee29592a8ee76b08984"
format_stamp: "Formatted at 2026-08-11 01:00:50 on dist-test-slave-42z9"
server_key: "915294775a5c461b9f5848c9a2e8be05"
server_key_iv: "fcd7294bfc17c3ad8e5d0eb53230a7c2"
server_key_version: "encryptionkey@0"
I20260811 01:00:50.439953 19621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "229ebbbd62cd4ee29592a8ee76b08984"
format_stamp: "Formatted at 2026-08-11 01:00:50 on dist-test-slave-42z9"
server_key: "915294775a5c461b9f5848c9a2e8be05"
server_key_iv: "fcd7294bfc17c3ad8e5d0eb53230a7c2"
server_key_version: "encryptionkey@0"
I20260811 01:00:50.441252 19621 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:50.442040 19644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:50.442461 19621 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:50.442639 19621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "229ebbbd62cd4ee29592a8ee76b08984"
format_stamp: "Formatted at 2026-08-11 01:00:50 on dist-test-slave-42z9"
server_key: "915294775a5c461b9f5848c9a2e8be05"
server_key_iv: "fcd7294bfc17c3ad8e5d0eb53230a7c2"
server_key_version: "encryptionkey@0"
I20260811 01:00:50.442754 19621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:50.454082 19621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:50.456271 19621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:50.456434 19621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:50.456725 19621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:50.457093 19621 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:50.457130 19621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:50.457162 19621 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:50.457180 19621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:50.464653 19621 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:34781
I20260811 01:00:50.464726 19839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:34781 every 8 connection(s)
I20260811 01:00:50.465086 19621 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:00:50.470245 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 19621
I20260811 01:00:50.470366 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:00:50.470557 13434 external_mini_cluster.cc:1428] Setting key bb78be5d70766c31b57262e388c2942f
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[19448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410050, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:50.476588 19608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:50.466076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:56963 (local address 127.13.30.190:34357)
0811 01:00:50.466177 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:50.466179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:50.466334 (+ 155us) server_negotiation.cc:407] Connection header received
0811 01:00:50.467328 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:50.467330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:50.467345 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:50.467440 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:50.468163 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.468919 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.470185 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.470553 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.470636 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:50.473594 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:50.473596 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:50.473596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:50.473608 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:50.474993 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:50.475526 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:50.475527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:50.475528 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:50.475587 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:50.475848 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:50.475849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:50.475850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:50.476006 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:50.476065 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:50.476372 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 01:00:50.476485 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 01:00:50.476811 19843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:50.465967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:34357 (local address 127.13.30.129:56963)
0811 01:00:50.466179 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:50.466226 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:50.467197 (+ 971us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:50.467505 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:50.467509 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:50.467826 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:50.468050 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:50.468055 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.469083 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.469084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:50.470081 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:50.470086 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.470687 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.470688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:50.470867 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:50.471519 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:50.471531 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:50.473421 (+ 1890us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:50.475106 (+ 1685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:50.475124 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:50.475127 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:50.475446 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:50.475645 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:50.475646 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:50.475647 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:50.475789 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:50.476066 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:50.476075 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:50.476244 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 01:00:50.476342 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 01:00:50.476552 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":107,"threads_started":1}
I20260811 01:00:50.477670 19841 heartbeater.cc:347] Connected to a master server at 127.13.30.190:34357
I20260811 01:00:50.477785 19841 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:50.477995 19841 heartbeater.cc:511] Master 127.13.30.190:34357 requested a full tablet report, sending...
I20260811 01:00:50.478585 19525 ts_manager.cc:194] Registered new tserver with Master: 229ebbbd62cd4ee29592a8ee76b08984 (127.13.30.129:34781)
I20260811 01:00:50.479239 19525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:56963
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:00:50.500551 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34357
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:50.587268 19853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:50.587502 19853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:50.587529 19853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:50.588735 19853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:50.588776 19853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:50.588804 19853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:00:50.590480 19853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:50.590737 19853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:50.590958 19853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:50.596714 19863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:50.596813 19860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:50.596900 19853 server_base.cc:1034] running on GCE node
W20260811 01:00:50.596813 19858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:50.597369 19853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:50.597745 19853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:50.598932 19853 hybrid_clock.cc:648] HybridClock initialized: now 1786410050598907 us; error 44 us; skew 500 ppm
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[19448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410050, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:50.601715 19853 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:00:50.602246 19853 webserver.cc:460] Webserver started at http://127.13.30.130:36073/ using document root <none> and password file <none>
I20260811 01:00:50.602488 19853 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:50.602540 19853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:50.602682 19853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:50.603789 19853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "b41e16a220434426bf117950c59a2810"
format_stamp: "Formatted at 2026-08-11 01:00:50 on dist-test-slave-42z9"
server_key: "2ead003ddd65cd25e819c0794a4e4025"
server_key_iv: "001852880cd20a8ef6379eeacfea894f"
server_key_version: "encryptionkey@0"
I20260811 01:00:50.604162 19853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "b41e16a220434426bf117950c59a2810"
format_stamp: "Formatted at 2026-08-11 01:00:50 on dist-test-slave-42z9"
server_key: "2ead003ddd65cd25e819c0794a4e4025"
server_key_iv: "001852880cd20a8ef6379eeacfea894f"
server_key_version: "encryptionkey@0"
I20260811 01:00:50.605603 19853 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:50.606376 19874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:50.606580 19853 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:50.606685 19853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "b41e16a220434426bf117950c59a2810"
format_stamp: "Formatted at 2026-08-11 01:00:50 on dist-test-slave-42z9"
server_key: "2ead003ddd65cd25e819c0794a4e4025"
server_key_iv: "001852880cd20a8ef6379eeacfea894f"
server_key_version: "encryptionkey@0"
I20260811 01:00:50.606775 19853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:50.631916 19853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:50.634502 19853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:50.634744 19853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:50.635164 19853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:50.635676 19853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:50.635716 19853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:50.635753 19853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:50.635779 19853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:50.641557 19853 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:42805
I20260811 01:00:50.641624 20055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:42805 every 8 connection(s)
I20260811 01:00:50.641949 19853 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:00:50.647262 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 19853
I20260811 01:00:50.647380 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:00:50.647575 13434 external_mini_cluster.cc:1428] Setting key 04872a17f74fe70fc233ea5360646a0f
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[19448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410050, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:50.651968 19608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:50.642746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:47729 (local address 127.13.30.190:34357)
0811 01:00:50.642831 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:50.642834 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:50.643012 (+ 178us) server_negotiation.cc:407] Connection header received
0811 01:00:50.643929 (+ 917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:50.643930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:50.643942 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:50.643992 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:50.644607 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.645114 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.646124 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.646325 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.646378 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:50.649056 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:50.649057 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:50.649058 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:50.649067 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:50.650617 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:50.651031 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:50.651032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:50.651032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:50.651101 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:50.651326 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:50.651327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:50.651328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:50.651480 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:50.651546 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:50.651785 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 01:00:50.651875 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 01:00:50.652070 20059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:50.642730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:34357 (local address 127.13.30.130:47729)
0811 01:00:50.642892 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:50.642931 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:50.643839 (+ 908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:50.644051 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:50.644054 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:50.644337 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:50.644542 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:50.644546 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.645182 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.645182 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:50.646036 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:50.646039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.646392 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.646393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:50.646519 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:50.647028 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:50.647042 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:50.648930 (+ 1888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:50.650702 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:50.650711 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:50.650713 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:50.650958 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:50.651159 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:50.651159 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:50.651160 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:50.651270 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:50.651539 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:50.651542 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:50.651669 (+ 127us) client_negotiation.cc:769] Sending connection context
0811 01:00:50.651749 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 01:00:50.651888 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":84,"threads_started":1}
I20260811 01:00:50.652499 20056 heartbeater.cc:347] Connected to a master server at 127.13.30.190:34357
I20260811 01:00:50.652592 20056 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:50.652770 20056 heartbeater.cc:511] Master 127.13.30.190:34357 requested a full tablet report, sending...
I20260811 01:00:50.653196 19525 ts_manager.cc:194] Registered new tserver with Master: b41e16a220434426bf117950c59a2810 (127.13.30.130:42805)
I20260811 01:00:50.653739 19525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:47729
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:00:50.673902 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34357
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:50.759613 20062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:50.759852 20062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:50.759881 20062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:50.761179 20062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:50.761245 20062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:50.761276 20062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:00:50.763019 20062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:50.763299 20062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:50.763542 20062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:50.768707 20071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:50.768718 20072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:50.768707 20076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:50.769025 20062 server_base.cc:1034] running on GCE node
I20260811 01:00:50.769263 20062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:50.769567 20062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:50.770725 20062 hybrid_clock.cc:648] HybridClock initialized: now 1786410050770711 us; error 31 us; skew 500 ppm
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[19448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410050, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:50.773288 20062 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:00:50.773787 20062 webserver.cc:460] Webserver started at http://127.13.30.131:38745/ using document root <none> and password file <none>
I20260811 01:00:50.774009 20062 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:50.774060 20062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:50.774199 20062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:50.775277 20062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "119945380ba1489c9a147eedafc09cb5"
format_stamp: "Formatted at 2026-08-11 01:00:50 on dist-test-slave-42z9"
server_key: "6657f24ec6e3322b714fff352db4210c"
server_key_iv: "a00e548772c51c814a027c3ce28cb5de"
server_key_version: "encryptionkey@0"
I20260811 01:00:50.775625 20062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "119945380ba1489c9a147eedafc09cb5"
format_stamp: "Formatted at 2026-08-11 01:00:50 on dist-test-slave-42z9"
server_key: "6657f24ec6e3322b714fff352db4210c"
server_key_iv: "a00e548772c51c814a027c3ce28cb5de"
server_key_version: "encryptionkey@0"
I20260811 01:00:50.776938 20062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:00:50.777657 20087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:50.777828 20062 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:50.777925 20062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "119945380ba1489c9a147eedafc09cb5"
format_stamp: "Formatted at 2026-08-11 01:00:50 on dist-test-slave-42z9"
server_key: "6657f24ec6e3322b714fff352db4210c"
server_key_iv: "a00e548772c51c814a027c3ce28cb5de"
server_key_version: "encryptionkey@0"
I20260811 01:00:50.778007 20062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:50.808805 20062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:50.811107 20062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:50.811255 20062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:50.811506 20062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:50.811829 20062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:50.811865 20062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:50.811895 20062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:50.811914 20062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:50.817761 20062 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:39391
I20260811 01:00:50.817834 20270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:39391 every 8 connection(s)
I20260811 01:00:50.818143 20062 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:00:50.819882 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 20062
I20260811 01:00:50.819972 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:00:50.820155 13434 external_mini_cluster.cc:1428] Setting key 4c7dd864ecc918015b65d51f079e0b26
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[19448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410050, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:50.827286 19608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:50.818856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:49041 (local address 127.13.30.190:34357)
0811 01:00:50.818918 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:50.818920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:50.819140 (+ 220us) server_negotiation.cc:407] Connection header received
0811 01:00:50.820104 (+ 964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:50.820106 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:50.820119 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:50.820202 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:50.820996 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.821558 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.822537 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.822733 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.822787 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:50.824818 (+ 2031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:50.824819 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:50.824820 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:50.824827 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:50.825993 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:50.826376 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:50.826377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:50.826378 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:50.826436 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:50.826653 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:50.826654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:50.826654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:50.826774 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:50.826832 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:50.827101 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 01:00:50.827188 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 01:00:50.827476 20274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:50.818837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:34357 (local address 127.13.30.131:49041)
0811 01:00:50.819014 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:50.819059 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:50.819983 (+ 924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:50.820283 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:50.820288 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:50.820651 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:50.820917 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:50.820924 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.821636 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.821637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:50.822449 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:50.822452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.822803 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.822804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:50.822943 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:50.823374 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:50.823382 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:50.824721 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:50.826068 (+ 1347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:50.826077 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:50.826079 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:50.826307 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:50.826490 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:50.826491 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:50.826491 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:50.826599 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:50.826833 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:50.826840 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:50.826980 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 01:00:50.827071 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 01:00:50.827244 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260811 01:00:50.827955 20271 heartbeater.cc:347] Connected to a master server at 127.13.30.190:34357
I20260811 01:00:50.828045 20271 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:50.828230 20271 heartbeater.cc:511] Master 127.13.30.190:34357 requested a full tablet report, sending...
I20260811 01:00:50.828598 19525 ts_manager.cc:194] Registered new tserver with Master: 119945380ba1489c9a147eedafc09cb5 (127.13.30.131:39391)
I20260811 01:00:50.828959 19525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:49041
I20260811 01:00:50.831687 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[19448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[19448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.129@KRBTEST.COM
I20260811 01:00:50.855396 20282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:50.847880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34858 (local address 127.13.30.129:34781)
0811 01:00:50.848069 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:50.848075 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:50.848086 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:00:50.848115 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:50.848117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:50.848131 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:50.848195 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:50.848758 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.849567 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.850295 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.850620 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.850675 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:50.852933 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:50.852952 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:50.852953 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:50.852961 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:50.854445 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:50.854763 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:50.854766 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:50.854766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:50.854825 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:50.854960 (+ 135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:50.854961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:50.854961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:50.855093 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:50.855195 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:50.855244 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 01:00:50.855311 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":102,"threads_started":1}
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[19448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:50.863766 19608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:50.856739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43848 (local address 127.13.30.190:34357)
0811 01:00:50.856794 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:50.856796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:50.856817 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:00:50.856860 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:50.856861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:50.856870 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:50.856916 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:50.857406 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.858011 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.858950 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:50.859145 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:50.859204 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:50.861599 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:50.861600 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:50.861600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:50.861609 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:50.862806 (+ 1197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:50.863136 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:50.863137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:50.863137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:50.863186 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:50.863316 (+ 130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:50.863316 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:50.863316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:50.863472 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:50.863545 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:50.863628 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 01:00:50.863693 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 01:00:50.864018 19525 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43848
I20260811 01:00:50.864369 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 19621
I20260811 01:00:50.874677 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 19853
I20260811 01:00:50.887267 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 20062
I20260811 01:00:50.903663 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 19471
2026-08-11T01:00:50Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2106 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[20289](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[20289](info): set up 2 sockets
Aug 11 01:00:50 dist-test-slave-42z9 krb5kdc[20289](info): commencing operation
krb5kdc: starting...
W20260811 01:00:52.084098 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:00:52 dist-test-slave-42z9 krb5kdc[20289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:00:52.209887 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:45117
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:42789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:45117
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:52.297533 20312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:52.297783 20312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:52.297819 20312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:52.299155 20312 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:52.299211 20312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:52.299232 20312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:52.299249 20312 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:52.299264 20312 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:52.301100 20312 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:42789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:45117
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:45117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:52.301419 20312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:52.301708 20312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:52.306701 20332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:52.306722 20330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:52.306711 20326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:52.306742 20312 server_base.cc:1034] running on GCE node
I20260811 01:00:52.307186 20312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:52.307518 20312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:52.308681 20312 hybrid_clock.cc:648] HybridClock initialized: now 1786410052308663 us; error 38 us; skew 500 ppm
Aug 11 01:00:52 dist-test-slave-42z9 krb5kdc[20289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410052, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:52.311359 20312 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:00:52.311774 20312 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:52.311829 20312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:52.311936 20312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:52.313099 20312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "39a3d58dc9004d259d0227f1795d61b4"
format_stamp: "Formatted at 2026-08-11 01:00:52 on dist-test-slave-42z9"
server_key: "815fa3cf34197fde85723f75471b443b"
server_key_iv: "22318b770584e94ee32178a74938004f"
server_key_version: "encryptionkey@0"
I20260811 01:00:52.313431 20312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "39a3d58dc9004d259d0227f1795d61b4"
format_stamp: "Formatted at 2026-08-11 01:00:52 on dist-test-slave-42z9"
server_key: "815fa3cf34197fde85723f75471b443b"
server_key_iv: "22318b770584e94ee32178a74938004f"
server_key_version: "encryptionkey@0"
I20260811 01:00:52.314838 20312 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:52.315595 20344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:52.315774 20312 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:52.315865 20312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "39a3d58dc9004d259d0227f1795d61b4"
format_stamp: "Formatted at 2026-08-11 01:00:52 on dist-test-slave-42z9"
server_key: "815fa3cf34197fde85723f75471b443b"
server_key_iv: "22318b770584e94ee32178a74938004f"
server_key_version: "encryptionkey@0"
I20260811 01:00:52.315954 20312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:52.326206 20312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:52.328451 20312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:52.328605 20312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:52.332816 20312 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:45117
I20260811 01:00:52.332854 20418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:45117 every 8 connection(s)
I20260811 01:00:52.333143 20312 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:52.334357 20420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:52.336321 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 20312
I20260811 01:00:52.336417 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:52.336585 13434 external_mini_cluster.cc:1428] Setting key ab7589e51e3355f4af58155f6d316e11
I20260811 01:00:52.336990 20420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4: Bootstrap starting.
I20260811 01:00:52.337771 20420 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:52.338119 20420 log.cc:824] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:52.338913 20420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4: No bootstrap required, opened a new log
I20260811 01:00:52.341153 20420 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39a3d58dc9004d259d0227f1795d61b4" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45117 } }
I20260811 01:00:52.341320 20420 raft_consensus.cc:374] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:52.341353 20420 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a3d58dc9004d259d0227f1795d61b4, State: Initialized, Role: FOLLOWER
I20260811 01:00:52.341564 20420 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39a3d58dc9004d259d0227f1795d61b4" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45117 } }
I20260811 01:00:52.341663 20420 raft_consensus.cc:388] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:52.341728 20420 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:52.341773 20420 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:52.342654 20420 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39a3d58dc9004d259d0227f1795d61b4" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45117 } }
I20260811 01:00:52.342788 20420 leader_election.cc:302] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39a3d58dc9004d259d0227f1795d61b4; no voters:
I20260811 01:00:52.343012 20420 leader_election.cc:288] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:52.343050 20428 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:52.343194 20428 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [term 1 LEADER]: Becoming Leader. State: Replica: 39a3d58dc9004d259d0227f1795d61b4, State: Running, Role: LEADER
I20260811 01:00:52.343286 20428 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39a3d58dc9004d259d0227f1795d61b4" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45117 } }
I20260811 01:00:52.343335 20420 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:52.343681 20430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39a3d58dc9004d259d0227f1795d61b4. Latest consensus state: current_term: 1 leader_uuid: "39a3d58dc9004d259d0227f1795d61b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39a3d58dc9004d259d0227f1795d61b4" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45117 } } }
Aug 11 01:00:52 dist-test-slave-42z9 krb5kdc[20289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:52.343772 20430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:52.343931 20429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39a3d58dc9004d259d0227f1795d61b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39a3d58dc9004d259d0227f1795d61b4" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45117 } } }
I20260811 01:00:52.343989 20429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:52.344074 20435 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:52.344748 20435 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:52.346676 20435 catalog_manager.cc:1347] Generated new cluster ID: 8dd8e0d675f64535bd7ae9dc3a401524
I20260811 01:00:52.346728 20435 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:52.348330 20424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:52.337142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51584 (local address 127.13.30.190:45117)
0811 01:00:52.337308 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:52.337316 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:52.337341 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:00:52.337861 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:52.337873 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:52.337926 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:52.338049 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:52.338786 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.339741 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.340854 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.341283 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.341388 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:52.344347 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:52.344352 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:52.344352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:52.344366 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:52.346629 (+ 2263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:52.347076 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:52.347079 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:52.347080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:52.347183 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:52.347395 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:52.347396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:52.347396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:52.347691 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:52.347812 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:52.347971 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 01:00:52.348112 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":73,"threads_started":1}
I20260811 01:00:52.361990 20435 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:52.362799 20435 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:52.378082 20435 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4: Generated new TSK 0
I20260811 01:00:52.378371 20435 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:00:52.412773 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45117
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:42789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:52.500221 20459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:52.500466 20459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:52.500494 20459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:52.501773 20459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:52.501823 20459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:52.501853 20459 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:00:52.503625 20459 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:42789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45117
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:52.503872 20459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:52.504078 20459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:52.509191 20467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:52.509202 20473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:52.509207 20466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:52.509356 20459 server_base.cc:1034] running on GCE node
I20260811 01:00:52.509686 20459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:52.509931 20459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:52.511077 20459 hybrid_clock.cc:648] HybridClock initialized: now 1786410052511059 us; error 29 us; skew 500 ppm
Aug 11 01:00:52 dist-test-slave-42z9 krb5kdc[20289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410052, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:52.513636 20459 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:00:52.513996 20459 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:52.514050 20459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:52.514183 20459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:52.515261 20459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "fe151ef128ec4fe1b1365ba62f0fff7d"
format_stamp: "Formatted at 2026-08-11 01:00:52 on dist-test-slave-42z9"
server_key: "90ffb421be3eb861a0a301075bb5e40e"
server_key_iv: "aad93a271b078aabf9a5021baa0bd208"
server_key_version: "encryptionkey@0"
I20260811 01:00:52.515692 20459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "fe151ef128ec4fe1b1365ba62f0fff7d"
format_stamp: "Formatted at 2026-08-11 01:00:52 on dist-test-slave-42z9"
server_key: "90ffb421be3eb861a0a301075bb5e40e"
server_key_iv: "aad93a271b078aabf9a5021baa0bd208"
server_key_version: "encryptionkey@0"
I20260811 01:00:52.517030 20459 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 01:00:52.517769 20482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:52.517920 20459 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:52.518006 20459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "fe151ef128ec4fe1b1365ba62f0fff7d"
format_stamp: "Formatted at 2026-08-11 01:00:52 on dist-test-slave-42z9"
server_key: "90ffb421be3eb861a0a301075bb5e40e"
server_key_iv: "aad93a271b078aabf9a5021baa0bd208"
server_key_version: "encryptionkey@0"
I20260811 01:00:52.518070 20459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:52.546165 20459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:52.548528 20459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:52.548684 20459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:52.548925 20459 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:52.549261 20459 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:52.549297 20459 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:52.549328 20459 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:52.549345 20459 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:52.555157 20459 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:45811
I20260811 01:00:52.555207 20672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:45811 every 8 connection(s)
I20260811 01:00:52.555505 20459 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:00:52.559405 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 20459
I20260811 01:00:52.559506 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:00:52.559665 13434 external_mini_cluster.cc:1428] Setting key bad59e0b9414924b8a892b2d719fce24
Aug 11 01:00:52 dist-test-slave-42z9 krb5kdc[20289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410052, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:52.565490 20424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:52.556280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:34939 (local address 127.13.30.190:45117)
0811 01:00:52.556336 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:52.556338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:52.556539 (+ 201us) server_negotiation.cc:407] Connection header received
0811 01:00:52.557013 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:52.557014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:52.557023 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:52.557086 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:52.558147 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.558658 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.559869 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.560137 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.560193 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:52.562574 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:52.562576 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:52.562577 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:52.562586 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:52.563908 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:52.564409 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:52.564409 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:52.564410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:52.564459 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:52.564724 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:52.564724 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:52.564724 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:52.564840 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:52.564887 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:52.565259 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 01:00:52.565355 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 01:00:52.565734 20677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:52.556234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45117 (local address 127.13.30.129:34939)
0811 01:00:52.556407 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:52.556454 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:52.556933 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:52.557143 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:52.557147 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:52.557425 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:52.558062 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:52.558069 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.558734 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.558735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:52.559786 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:52.559789 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.560221 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.560222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:52.560338 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:52.560879 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:52.560890 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:52.562467 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:52.564003 (+ 1536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:52.564015 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:52.564018 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:52.564337 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:52.564512 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:52.564513 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:52.564513 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:52.564664 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:52.564898 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:52.564908 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:52.565119 (+ 211us) client_negotiation.cc:769] Sending connection context
0811 01:00:52.565249 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 01:00:52.565478 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":71,"threads_started":1}
I20260811 01:00:52.566385 20673 heartbeater.cc:347] Connected to a master server at 127.13.30.190:45117
I20260811 01:00:52.566504 20673 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:52.566676 20673 heartbeater.cc:511] Master 127.13.30.190:45117 requested a full tablet report, sending...
I20260811 01:00:52.567224 20369 ts_manager.cc:194] Registered new tserver with Master: fe151ef128ec4fe1b1365ba62f0fff7d (127.13.30.129:45811)
I20260811 01:00:52.567876 20369 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:34939
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:00:52.588075 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45117
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:42789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:52.673838 20680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:52.674080 20680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:52.674118 20680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:52.675386 20680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:52.675438 20680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:52.675477 20680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:00:52.677371 20680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:42789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45117
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:52.677681 20680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:52.677932 20680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:52.683197 20686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:52.683216 20689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:52.683209 20687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:52.683403 20680 server_base.cc:1034] running on GCE node
I20260811 01:00:52.683632 20680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:52.683874 20680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:52.685007 20680 hybrid_clock.cc:648] HybridClock initialized: now 1786410052684998 us; error 30 us; skew 500 ppm
Aug 11 01:00:52 dist-test-slave-42z9 krb5kdc[20289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410052, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:52.687619 20680 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:00:52.687981 20680 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:52.688038 20680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:52.688166 20680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:52.689261 20680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "54caecf4bb9b413ab45f216bd832d059"
format_stamp: "Formatted at 2026-08-11 01:00:52 on dist-test-slave-42z9"
server_key: "3660e5c10eccfb656cfd69c0963c5a96"
server_key_iv: "35b2c32c12af2e61ca31a0339b26bd01"
server_key_version: "encryptionkey@0"
I20260811 01:00:52.689656 20680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "54caecf4bb9b413ab45f216bd832d059"
format_stamp: "Formatted at 2026-08-11 01:00:52 on dist-test-slave-42z9"
server_key: "3660e5c10eccfb656cfd69c0963c5a96"
server_key_iv: "35b2c32c12af2e61ca31a0339b26bd01"
server_key_version: "encryptionkey@0"
I20260811 01:00:52.691013 20680 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:52.691743 20702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:52.691911 20680 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 01:00:52.692004 20680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "54caecf4bb9b413ab45f216bd832d059"
format_stamp: "Formatted at 2026-08-11 01:00:52 on dist-test-slave-42z9"
server_key: "3660e5c10eccfb656cfd69c0963c5a96"
server_key_iv: "35b2c32c12af2e61ca31a0339b26bd01"
server_key_version: "encryptionkey@0"
I20260811 01:00:52.692075 20680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:52.700250 20680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:52.702513 20680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:52.702661 20680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:52.702893 20680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:52.703213 20680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:52.703248 20680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:52.703277 20680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:52.703302 20680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:52.710456 20680 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:37805
I20260811 01:00:52.710511 20891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:37805 every 8 connection(s)
I20260811 01:00:52.710809 20680 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:00:52.714179 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 20680
I20260811 01:00:52.714282 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:00:52.714469 13434 external_mini_cluster.cc:1428] Setting key 1c4acfeb24e6d14f46d743eabc1670bc
Aug 11 01:00:52 dist-test-slave-42z9 krb5kdc[20289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410052, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:52.720927 20424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:52.711578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:60947 (local address 127.13.30.190:45117)
0811 01:00:52.711642 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:52.711644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:52.711857 (+ 213us) server_negotiation.cc:407] Connection header received
0811 01:00:52.712386 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:52.712387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:52.712402 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:52.712449 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:52.713480 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.714023 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.715223 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.715494 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.715567 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:52.717859 (+ 2292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:52.717861 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:52.717861 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:52.717869 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:52.719357 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:52.719900 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:52.719901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:52.719901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:52.719958 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:52.720222 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:52.720222 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:52.720223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:52.720331 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:52.720380 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:52.720746 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 01:00:52.720848 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 01:00:52.721174 20897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:52.711557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45117 (local address 127.13.30.130:60947)
0811 01:00:52.711718 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:52.711759 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:52.712266 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:52.712520 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:52.712523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:52.712816 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:52.713354 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:52.713360 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.714119 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.714120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:52.715135 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:52.715139 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.715570 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.715571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:52.715682 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:52.716209 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:52.716218 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:52.717753 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:52.719449 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:52.719459 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:52.719461 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:52.719813 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:52.720016 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:52.720017 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:52.720018 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:52.720157 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:52.720390 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:52.720397 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:52.720585 (+ 188us) client_negotiation.cc:769] Sending connection context
0811 01:00:52.720711 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 01:00:52.720914 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
I20260811 01:00:52.721673 20892 heartbeater.cc:347] Connected to a master server at 127.13.30.190:45117
I20260811 01:00:52.721786 20892 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:52.721974 20892 heartbeater.cc:511] Master 127.13.30.190:45117 requested a full tablet report, sending...
I20260811 01:00:52.722388 20369 ts_manager.cc:194] Registered new tserver with Master: 54caecf4bb9b413ab45f216bd832d059 (127.13.30.130:37805)
I20260811 01:00:52.722774 20369 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:60947
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:00:52.742100 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45117
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:42789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:52.827797 20903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:52.828025 20903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:52.828051 20903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:52.829310 20903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:52.829376 20903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:52.829406 20903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:00:52.831664 20903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:42789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45117
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:52.831979 20903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:52.832291 20903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:52.838253 20910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:52.838253 20911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:52.838347 20915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:52.838796 20903 server_base.cc:1034] running on GCE node
I20260811 01:00:52.839037 20903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:52.839354 20903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:52.840521 20903 hybrid_clock.cc:648] HybridClock initialized: now 1786410052840508 us; error 34 us; skew 500 ppm
Aug 11 01:00:52 dist-test-slave-42z9 krb5kdc[20289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410052, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:52.843080 20903 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:00:52.843478 20903 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:52.843534 20903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:52.843662 20903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:52.844825 20903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "431723bc812b4c4bb57522be5749d191"
format_stamp: "Formatted at 2026-08-11 01:00:52 on dist-test-slave-42z9"
server_key: "3edb16ad95466592d72294eadc81e03e"
server_key_iv: "5d2081626e3c7f9775ed47f741fad7c2"
server_key_version: "encryptionkey@0"
I20260811 01:00:52.845196 20903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "431723bc812b4c4bb57522be5749d191"
format_stamp: "Formatted at 2026-08-11 01:00:52 on dist-test-slave-42z9"
server_key: "3edb16ad95466592d72294eadc81e03e"
server_key_iv: "5d2081626e3c7f9775ed47f741fad7c2"
server_key_version: "encryptionkey@0"
I20260811 01:00:52.846530 20903 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 01:00:52.847335 20923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:52.847486 20903 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:52.847568 20903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "431723bc812b4c4bb57522be5749d191"
format_stamp: "Formatted at 2026-08-11 01:00:52 on dist-test-slave-42z9"
server_key: "3edb16ad95466592d72294eadc81e03e"
server_key_iv: "5d2081626e3c7f9775ed47f741fad7c2"
server_key_version: "encryptionkey@0"
I20260811 01:00:52.847640 20903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:52.865803 20903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:52.867637 20903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:52.867780 20903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:52.868039 20903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:52.868389 20903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:52.868429 20903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:52.868453 20903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:52.868476 20903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:52.874516 20903 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:38453
I20260811 01:00:52.874558 21101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:38453 every 8 connection(s)
I20260811 01:00:52.874831 20903 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:00:52.878506 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 20903
I20260811 01:00:52.878602 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:00:52.878777 13434 external_mini_cluster.cc:1428] Setting key 14f13c87bf6c4fb8fd08bec0f6abca14
Aug 11 01:00:52 dist-test-slave-42z9 krb5kdc[20289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410052, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:52.884730 20424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:52.875561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:36789 (local address 127.13.30.190:45117)
0811 01:00:52.875624 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:52.875626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:52.875826 (+ 200us) server_negotiation.cc:407] Connection header received
0811 01:00:52.876366 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:52.876368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:52.876382 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:52.876433 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:52.877478 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.878008 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.879338 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.879557 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.879620 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:52.881769 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:52.881771 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:52.881771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:52.881778 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:52.882872 (+ 1094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:52.883297 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:52.883298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:52.883298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:52.883369 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:52.883953 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:52.883954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:52.883954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:52.884091 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:52.884161 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:52.884570 (+ 409us) server_negotiation.cc:299] Negotiation successful
0811 01:00:52.884655 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 01:00:52.884861 21105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:52.875530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45117 (local address 127.13.30.131:36789)
0811 01:00:52.875698 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:52.875737 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:52.876255 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:52.876518 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:52.876522 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:52.876813 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:52.877347 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:52.877354 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.878135 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.878137 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:52.879224 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:52.879228 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.879649 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.879650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:52.879783 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:52.880239 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:52.880248 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:52.881666 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:52.882943 (+ 1277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:52.882951 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:52.882953 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:52.883193 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:52.883540 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:52.883542 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:52.883543 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:52.883820 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:52.884231 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:52.884239 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:52.884394 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 01:00:52.884504 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 01:00:52.884659 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260811 01:00:52.885407 21102 heartbeater.cc:347] Connected to a master server at 127.13.30.190:45117
I20260811 01:00:52.885548 21102 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:52.885694 21102 heartbeater.cc:511] Master 127.13.30.190:45117 requested a full tablet report, sending...
I20260811 01:00:52.886037 20369 ts_manager.cc:194] Registered new tserver with Master: 431723bc812b4c4bb57522be5749d191 (127.13.30.131:38453)
I20260811 01:00:52.886415 20369 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:36789
I20260811 01:00:52.890316 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:00:52.897943 20424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:52.891631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51586 (local address 127.13.30.190:45117)
0811 01:00:52.891700 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:52.891702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:52.891762 (+ 60us) server_negotiation.cc:407] Connection header received
0811 01:00:52.891843 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:52.891844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:52.891854 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:52.891899 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:52.892475 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.892978 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.893727 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.893929 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.893983 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:52.895198 (+ 1215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:52.895199 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:52.895199 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:52.895208 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:52.896771 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:52.897110 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:52.897111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:52.897111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:52.897171 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:52.897331 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:52.897332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:52.897332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:52.897555 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:52.897644 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:52.897762 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 01:00:52.897844 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 01:00:52.899426 20369 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:00:52.901047 20369 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:00:52.907745 21118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:52.903346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:38453 (local address 127.0.0.1:41978)
0811 01:00:52.903480 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:52.903524 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:52.903589 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:52.904224 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:52.904225 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:52.904228 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:52.904282 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:52.904284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.905692 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.905693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:52.906696 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:52.906699 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.907454 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.907455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:52.907532 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:52.907537 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:00:52.907598 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 01:00:52.907646 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":78,"threads_started":1}
I20260811 01:00:52.907753 21126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:52.903881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41978 (local address 127.13.30.131:38453)
0811 01:00:52.904042 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:52.904047 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:52.904057 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:00:52.904098 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:52.904100 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:52.904116 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:52.904354 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:52.904434 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.905586 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.906786 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.907340 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.907443 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:52.907508 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:52.907619 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 01:00:52.907667 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":66,"threads_started":1}
I20260811 01:00:52.907923 21119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:52.903352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:37805 (local address 127.0.0.1:52486)
0811 01:00:52.903504 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:52.903532 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:52.903589 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:52.904040 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:52.904044 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:52.904046 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:52.904122 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:52.904124 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.905168 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.905169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:52.906395 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:52.906398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.907351 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.907352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:52.907453 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:52.907470 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 01:00:52.907539 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 01:00:52.907607 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":1,"thread_start_us":110,"threads_started":1}
I20260811 01:00:52.907969 21124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:52.903740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52486 (local address 127.13.30.130:37805)
0811 01:00:52.903887 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:52.903891 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:52.903899 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:00:52.903935 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:52.903936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:52.903956 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:52.904022 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:52.904202 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.905080 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.906492 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.907256 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.907331 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:52.907395 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:52.907703 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 01:00:52.907754 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":65,"threads_started":1}
I20260811 01:00:52.908118 21127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:52.904139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46960 (local address 127.13.30.129:45811)
0811 01:00:52.904339 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:52.904344 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:52.904353 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:00:52.904393 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:52.904395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:52.904410 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:52.904509 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:52.904621 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.905681 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.906860 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.907583 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.907642 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:52.907696 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:52.907980 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 01:00:52.908030 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":90,"threads_started":1}
I20260811 01:00:52.908223 21122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:52.903586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:45811 (local address 127.0.0.1:46960)
0811 01:00:52.903697 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:52.903705 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:52.903739 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:52.904510 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:52.904511 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:52.904513 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:52.904563 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:52.904564 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.905786 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.905787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:52.906761 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:52.906764 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:52.907731 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:52.907732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:52.907788 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:52.907791 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:00:52.907839 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 01:00:52.907879 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":78,"threads_started":1}
I20260811 01:00:52.908752 20780 tablet_service.cc:1467] Processing CreateTablet for tablet 30e2de8ff5ae4e61853f9eee973d1f57 (DEFAULT_TABLE table=test-table [id=bee930fbfb964218b11a304dddeae764]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:52.908900 20556 tablet_service.cc:1467] Processing CreateTablet for tablet 30e2de8ff5ae4e61853f9eee973d1f57 (DEFAULT_TABLE table=test-table [id=bee930fbfb964218b11a304dddeae764]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:52.909133 20999 tablet_service.cc:1467] Processing CreateTablet for tablet 30e2de8ff5ae4e61853f9eee973d1f57 (DEFAULT_TABLE table=test-table [id=bee930fbfb964218b11a304dddeae764]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:52.909257 20780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30e2de8ff5ae4e61853f9eee973d1f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:52.909273 20556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30e2de8ff5ae4e61853f9eee973d1f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:52.909495 20999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30e2de8ff5ae4e61853f9eee973d1f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:52.912026 21132 tablet_bootstrap.cc:492] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059: Bootstrap starting.
I20260811 01:00:52.912705 21134 tablet_bootstrap.cc:492] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d: Bootstrap starting.
I20260811 01:00:52.912947 21136 tablet_bootstrap.cc:492] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191: Bootstrap starting.
I20260811 01:00:52.913008 21132 tablet_bootstrap.cc:654] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:52.913371 21134 tablet_bootstrap.cc:654] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:52.913602 21136 tablet_bootstrap.cc:654] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:52.913645 21132 log.cc:824] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:52.914023 21134 log.cc:824] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:52.914165 21136 log.cc:824] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:52.914613 21132 tablet_bootstrap.cc:492] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059: No bootstrap required, opened a new log
I20260811 01:00:52.914686 21132 ts_tablet_manager.cc:1397] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 01:00:52.914921 21136 tablet_bootstrap.cc:492] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191: No bootstrap required, opened a new log
I20260811 01:00:52.914994 21136 ts_tablet_manager.cc:1397] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:00:52.916157 21132 raft_consensus.cc:348] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431723bc812b4c4bb57522be5749d191" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38453 } } peers { permanent_uuid: "54caecf4bb9b413ab45f216bd832d059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37805 } } peers { permanent_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 45811 } }
I20260811 01:00:52.916330 21132 raft_consensus.cc:374] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:52.916371 21132 raft_consensus.cc:729] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54caecf4bb9b413ab45f216bd832d059, State: Initialized, Role: FOLLOWER
I20260811 01:00:52.916481 21132 consensus_queue.cc:260] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431723bc812b4c4bb57522be5749d191" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38453 } } peers { permanent_uuid: "54caecf4bb9b413ab45f216bd832d059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37805 } } peers { permanent_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 45811 } }
I20260811 01:00:52.916465 21136 raft_consensus.cc:348] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431723bc812b4c4bb57522be5749d191" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38453 } } peers { permanent_uuid: "54caecf4bb9b413ab45f216bd832d059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37805 } } peers { permanent_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 45811 } }
I20260811 01:00:52.916622 21136 raft_consensus.cc:374] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:52.916654 21136 raft_consensus.cc:729] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 431723bc812b4c4bb57522be5749d191, State: Initialized, Role: FOLLOWER
I20260811 01:00:52.916793 21132 ts_tablet_manager.cc:1428] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:00:52.916767 21136 consensus_queue.cc:260] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431723bc812b4c4bb57522be5749d191" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38453 } } peers { permanent_uuid: "54caecf4bb9b413ab45f216bd832d059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37805 } } peers { permanent_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 45811 } }
I20260811 01:00:52.916913 20892 heartbeater.cc:503] Master 127.13.30.190:45117 was elected leader, sending a full tablet report...
I20260811 01:00:52.917038 21136 ts_tablet_manager.cc:1428] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:00:52.917042 21102 heartbeater.cc:503] Master 127.13.30.190:45117 was elected leader, sending a full tablet report...
I20260811 01:00:52.917798 21134 tablet_bootstrap.cc:492] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d: No bootstrap required, opened a new log
I20260811 01:00:52.917877 21134 ts_tablet_manager.cc:1397] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260811 01:00:52.919463 21134 raft_consensus.cc:348] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431723bc812b4c4bb57522be5749d191" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38453 } } peers { permanent_uuid: "54caecf4bb9b413ab45f216bd832d059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37805 } } peers { permanent_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 45811 } }
I20260811 01:00:52.919612 21134 raft_consensus.cc:374] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:52.919634 21134 raft_consensus.cc:729] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe151ef128ec4fe1b1365ba62f0fff7d, State: Initialized, Role: FOLLOWER
I20260811 01:00:52.919754 21134 consensus_queue.cc:260] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431723bc812b4c4bb57522be5749d191" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38453 } } peers { permanent_uuid: "54caecf4bb9b413ab45f216bd832d059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37805 } } peers { permanent_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 45811 } }
I20260811 01:00:52.920034 21134 ts_tablet_manager.cc:1428] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260811 01:00:52.920084 20673 heartbeater.cc:503] Master 127.13.30.190:45117 was elected leader, sending a full tablet report...
W20260811 01:00:52.961416 20894 tablet.cc:2369] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:00:53.056303 20675 tablet.cc:2369] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:00:53.125396 21103 tablet.cc:2369] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:00:53.220772 21147 raft_consensus.cc:482] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:00:53.220957 21147 raft_consensus.cc:504] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431723bc812b4c4bb57522be5749d191" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38453 } } peers { permanent_uuid: "54caecf4bb9b413ab45f216bd832d059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37805 } } peers { permanent_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 45811 } }
I20260811 01:00:53.221319 21147 leader_election.cc:288] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 431723bc812b4c4bb57522be5749d191 (127.13.30.131:38453), 54caecf4bb9b413ab45f216bd832d059 (127.13.30.130:37805)
I20260811 01:00:53.224445 21124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.221750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:44287 (local address 127.13.30.130:37805)
0811 01:00:53.221805 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:53.221807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:53.221831 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:00:53.221907 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:53.221908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:53.221916 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:53.221958 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:53.222137 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:53.222616 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:53.223714 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:53.224097 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:53.224155 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:53.224165 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:53.224330 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 01:00:53.224371 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 01:00:53.224447 21126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.221649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:37539 (local address 127.13.30.131:38453)
0811 01:00:53.221714 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:53.221716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:53.221802 (+ 86us) server_negotiation.cc:407] Connection header received
0811 01:00:53.221889 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:53.221890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:53.221900 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:53.221956 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:00:53.222126 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:53.222614 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:53.223705 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:53.224111 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:53.224182 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:53.224191 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:53.224338 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 01:00:53.224381 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 01:00:53.224471 21149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.221605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:37805 (local address 127.13.30.129:44287)
0811 01:00:53.221770 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:53.221780 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:53.221840 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:53.221976 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:53.221977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:53.221979 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:53.222065 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:53.222067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:53.222706 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:53.222707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:53.223614 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:53.223617 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:53.224184 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:53.224185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:53.224257 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:53.224261 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:00:53.224306 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 01:00:53.224354 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":3,"thread_start_us":68,"threads_started":1}
I20260811 01:00:53.224473 21148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.221554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:38453 (local address 127.13.30.129:37539)
0811 01:00:53.221704 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:53.221732 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:53.221808 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:53.221968 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:53.221969 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:53.221971 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:00:53.222057 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:53.222059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:53.222701 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:53.222702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:53.223601 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:53.223604 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:53.224191 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:53.224192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:53.224265 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:53.224268 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:00:53.224326 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 01:00:53.224370 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":79,"thread_start_us":91,"threads_started":1}
I20260811 01:00:53.224848 20810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30e2de8ff5ae4e61853f9eee973d1f57" candidate_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54caecf4bb9b413ab45f216bd832d059" is_pre_election: true
I20260811 01:00:53.225049 20810 raft_consensus.cc:2454] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe151ef128ec4fe1b1365ba62f0fff7d in term 0.
I20260811 01:00:53.225051 21023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30e2de8ff5ae4e61853f9eee973d1f57" candidate_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "431723bc812b4c4bb57522be5749d191" is_pre_election: true
I20260811 01:00:53.225198 21023 raft_consensus.cc:2454] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe151ef128ec4fe1b1365ba62f0fff7d in term 0.
I20260811 01:00:53.225289 20483 leader_election.cc:302] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54caecf4bb9b413ab45f216bd832d059, fe151ef128ec4fe1b1365ba62f0fff7d; no voters:
I20260811 01:00:53.225458 21147 raft_consensus.cc:2781] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:00:53.225525 21147 raft_consensus.cc:482] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:00:53.225545 21147 raft_consensus.cc:3037] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:53.226308 21147 raft_consensus.cc:504] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431723bc812b4c4bb57522be5749d191" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38453 } } peers { permanent_uuid: "54caecf4bb9b413ab45f216bd832d059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37805 } } peers { permanent_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 45811 } }
I20260811 01:00:53.226455 21147 leader_election.cc:288] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [CANDIDATE]: Term 1 election: Requested vote from peers 431723bc812b4c4bb57522be5749d191 (127.13.30.131:38453), 54caecf4bb9b413ab45f216bd832d059 (127.13.30.130:37805)
I20260811 01:00:53.226617 21023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30e2de8ff5ae4e61853f9eee973d1f57" candidate_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "431723bc812b4c4bb57522be5749d191"
I20260811 01:00:53.226698 21023 raft_consensus.cc:3037] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:53.227463 21023 raft_consensus.cc:2454] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe151ef128ec4fe1b1365ba62f0fff7d in term 1.
I20260811 01:00:53.227586 20810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30e2de8ff5ae4e61853f9eee973d1f57" candidate_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54caecf4bb9b413ab45f216bd832d059"
I20260811 01:00:53.227653 20484 leader_election.cc:302] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 431723bc812b4c4bb57522be5749d191, fe151ef128ec4fe1b1365ba62f0fff7d; no voters:
I20260811 01:00:53.227674 20810 raft_consensus.cc:3037] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:53.227739 21147 raft_consensus.cc:2781] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:53.227941 21147 raft_consensus.cc:686] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [term 1 LEADER]: Becoming Leader. State: Replica: fe151ef128ec4fe1b1365ba62f0fff7d, State: Running, Role: LEADER
I20260811 01:00:53.228057 21147 consensus_queue.cc:237] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431723bc812b4c4bb57522be5749d191" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38453 } } peers { permanent_uuid: "54caecf4bb9b413ab45f216bd832d059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37805 } } peers { permanent_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 45811 } }
I20260811 01:00:53.228608 20810 raft_consensus.cc:2454] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe151ef128ec4fe1b1365ba62f0fff7d in term 1.
I20260811 01:00:53.229017 20369 catalog_manager.cc:5495] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d reported cstate change: term changed from 0 to 1, leader changed from <none> to fe151ef128ec4fe1b1365ba62f0fff7d (127.13.30.129). New cstate: current_term: 1 leader_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431723bc812b4c4bb57522be5749d191" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54caecf4bb9b413ab45f216bd832d059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe151ef128ec4fe1b1365ba62f0fff7d" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 45811 } health_report { overall_health: HEALTHY } } }
I20260811 01:00:53.262454 21127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.260181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46962 (local address 127.13.30.129:45811)
0811 01:00:53.260240 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:53.260242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:53.260249 (+ 7us) server_negotiation.cc:407] Connection header received
0811 01:00:53.260289 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:53.260290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:53.260309 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:53.260371 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:00:53.260504 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:53.260989 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:53.261782 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:53.261988 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:53.262043 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:53.262167 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:00:53.262275 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:00:53.262332 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:53.262362 (+ 30us) server_negotiation.cc:299] Negotiation successful
0811 01:00:53.262382 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 01:00:53.264443 20810 raft_consensus.cc:1261] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059 [term 1 FOLLOWER]: Refusing update from remote peer fe151ef128ec4fe1b1365ba62f0fff7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:53.264447 21023 raft_consensus.cc:1261] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191 [term 1 FOLLOWER]: Refusing update from remote peer fe151ef128ec4fe1b1365ba62f0fff7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:53.264827 21147 consensus_queue.cc:1035] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "431723bc812b4c4bb57522be5749d191" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:53.264981 21150 consensus_queue.cc:1035] T 30e2de8ff5ae4e61853f9eee973d1f57 P fe151ef128ec4fe1b1365ba62f0fff7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "54caecf4bb9b413ab45f216bd832d059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:53.267799 21155 mvcc.cc:205] Tried to move back new op lower bound from 7317135578168098816 to 7317135578022789120. Current Snapshot: MvccSnapshot[applied={T|T < 7317135578168098816}]
I20260811 01:00:53.268527 21154 mvcc.cc:205] Tried to move back new op lower bound from 7317135578168098816 to 7317135578022789120. Current Snapshot: MvccSnapshot[applied={T|T < 7317135578168098816 or (T in {7317135578168098816})}]
I20260811 01:00:53.269917 20369 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:53.270017 20369 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:53.270807 20369 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 39a3d58dc9004d259d0227f1795d61b4: Sending DeleteTablet for 3 replicas of tablet 30e2de8ff5ae4e61853f9eee973d1f57
I20260811 01:00:53.271178 20999 tablet_service.cc:1514] Processing DeleteTablet for tablet 30e2de8ff5ae4e61853f9eee973d1f57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:53 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:41978
I20260811 01:00:53.271183 20780 tablet_service.cc:1514] Processing DeleteTablet for tablet 30e2de8ff5ae4e61853f9eee973d1f57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:53 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:52486
I20260811 01:00:53.271485 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 20459
I20260811 01:00:53.271484 20556 tablet_service.cc:1514] Processing DeleteTablet for tablet 30e2de8ff5ae4e61853f9eee973d1f57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:53 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:46960
I20260811 01:00:53.283653 21167 tablet_replica.cc:330] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059: stopping tablet replica
I20260811 01:00:53.283872 21167 raft_consensus.cc:2229] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:53.284042 21167 raft_consensus.cc:2258] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:53.284267 21166 tablet_replica.cc:330] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191: stopping tablet replica
I20260811 01:00:53.284427 21166 raft_consensus.cc:2229] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:53.284546 21166 raft_consensus.cc:2258] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:53.284664 21167 ts_tablet_manager.cc:1905] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:53.285017 21166 ts_tablet_manager.cc:1905] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:53.286602 21167 ts_tablet_manager.cc:1918] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:00:53.286707 21167 log.cc:1196] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/30e2de8ff5ae4e61853f9eee973d1f57
I20260811 01:00:53.286720 21166 ts_tablet_manager.cc:1918] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:00:53.286780 21166 log.cc:1196] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/30e2de8ff5ae4e61853f9eee973d1f57
I20260811 01:00:53.287038 21166 ts_tablet_manager.cc:1939] T 30e2de8ff5ae4e61853f9eee973d1f57 P 431723bc812b4c4bb57522be5749d191: Deleting consensus metadata
I20260811 01:00:53.287094 21167 ts_tablet_manager.cc:1939] T 30e2de8ff5ae4e61853f9eee973d1f57 P 54caecf4bb9b413ab45f216bd832d059: Deleting consensus metadata
I20260811 01:00:53.287573 20348 catalog_manager.cc:4841] TS 431723bc812b4c4bb57522be5749d191 (127.13.30.131:38453): tablet 30e2de8ff5ae4e61853f9eee973d1f57 (table test-table [id=bee930fbfb964218b11a304dddeae764]) successfully deleted
I20260811 01:00:53.287576 20345 catalog_manager.cc:4841] TS 54caecf4bb9b413ab45f216bd832d059 (127.13.30.130:37805): tablet 30e2de8ff5ae4e61853f9eee973d1f57 (table test-table [id=bee930fbfb964218b11a304dddeae764]) successfully deleted
W20260811 01:00:53.288605 20345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:45811 (error 108)
I20260811 01:00:53.289166 21122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.289024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:45811 (local address 127.0.0.1:46976)
0811 01:00:53.289083 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:53.289128 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:45811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 01:00:53.289212 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 20680
W20260811 01:00:53.289294 20345 catalog_manager.cc:4584] TS fe151ef128ec4fe1b1365ba62f0fff7d (127.13.30.129:45811): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 30e2de8ff5ae4e61853f9eee973d1f57: Network error: Client connection negotiation failed: client connection to 127.13.30.129:45811: connect: Connection refused (error 111)
I20260811 01:00:53.300194 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 20903
I20260811 01:00:53.319278 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 20312
2026-08-11T01:00:53Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2416 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T01:00:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:53Z Disabled control of system clock
I20260811 01:00:53.355341 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:42247
--webserver_interface=127.13.30.190
--webserver_port=0
--builtin_ntp_servers=127.13.30.148:34237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:42247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 01:00:53.440181 21176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:53.440426 21176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:53.440449 21176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:53.441723 21176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:53.441779 21176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:53.441792 21176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:53.441803 21176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:53.441815 21176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:53.443310 21176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:42247
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:42247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:53.443576 21176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:53.443879 21176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:53.448859 21185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:53.448864 21189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:53.448916 21183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:53.449112 21176 server_base.cc:1034] running on GCE node
I20260811 01:00:53.449467 21176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:53.449839 21176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:53.451000 21176 hybrid_clock.cc:648] HybridClock initialized: now 1786410053450987 us; error 46 us; skew 500 ppm
I20260811 01:00:53.452328 21176 webserver.cc:460] Webserver started at http://127.13.30.190:33549/ using document root <none> and password file <none>
I20260811 01:00:53.452564 21176 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:53.452616 21176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:53.452744 21176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:53.453936 21176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "6167ee98bdba4e439e5e7954ace4d369"
format_stamp: "Formatted at 2026-08-11 01:00:53 on dist-test-slave-42z9"
server_key: "ab1c1a925f84483eb91918a01fef4bd9"
server_key_iv: "5186a6f8ccf9706b12036ee6a1c25aef"
server_key_version: "encryptionkey@0"
I20260811 01:00:53.454285 21176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "6167ee98bdba4e439e5e7954ace4d369"
format_stamp: "Formatted at 2026-08-11 01:00:53 on dist-test-slave-42z9"
server_key: "ab1c1a925f84483eb91918a01fef4bd9"
server_key_iv: "5186a6f8ccf9706b12036ee6a1c25aef"
server_key_version: "encryptionkey@0"
I20260811 01:00:53.455842 21176 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:00:53.456768 21203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:53.456955 21176 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:53.457065 21176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "6167ee98bdba4e439e5e7954ace4d369"
format_stamp: "Formatted at 2026-08-11 01:00:53 on dist-test-slave-42z9"
server_key: "ab1c1a925f84483eb91918a01fef4bd9"
server_key_iv: "5186a6f8ccf9706b12036ee6a1c25aef"
server_key_version: "encryptionkey@0"
I20260811 01:00:53.457147 21176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:53.460813 21176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:53.461119 21176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:53.461252 21176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:53.465325 21176 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:42247
I20260811 01:00:53.465363 21283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:42247 every 8 connection(s)
I20260811 01:00:53.465755 21176 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:53.466488 21285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:53.469671 21285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369: Bootstrap starting.
I20260811 01:00:53.470055 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 21176
I20260811 01:00:53.470146 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:53.470319 13434 external_mini_cluster.cc:1428] Setting key 813630b875ae62149333328a35c561f3
I20260811 01:00:53.470397 21285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:53.470702 21285 log.cc:824] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:53.471451 21285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369: No bootstrap required, opened a new log
I20260811 01:00:53.472887 21290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.470857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34710 (local address 127.13.30.190:42247)
0811 01:00:53.471079 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:53.471088 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:53.471121 (+ 33us) server_negotiation.cc:407] Connection header received
0811 01:00:53.471607 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:53.471614 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:53.471653 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:53.471783 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:53.472456 (+ 673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:53.472459 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:53.472460 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:53.472464 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:53.472509 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:53.472519 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:53.472592 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:53.472642 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 01:00:53.472702 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":77,"threads_started":1}
I20260811 01:00:53.473136 21285 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6167ee98bdba4e439e5e7954ace4d369" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42247 } }
I20260811 01:00:53.473300 21285 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:53.473337 21285 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6167ee98bdba4e439e5e7954ace4d369, State: Initialized, Role: FOLLOWER
I20260811 01:00:53.473485 21285 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6167ee98bdba4e439e5e7954ace4d369" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42247 } }
I20260811 01:00:53.473590 21285 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:53.473635 21285 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:53.473685 21285 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:53.474597 21285 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6167ee98bdba4e439e5e7954ace4d369" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42247 } }
I20260811 01:00:53.474694 21285 leader_election.cc:302] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6167ee98bdba4e439e5e7954ace4d369; no voters:
I20260811 01:00:53.474829 21285 leader_election.cc:288] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:53.474891 21291 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:53.475041 21291 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [term 1 LEADER]: Becoming Leader. State: Replica: 6167ee98bdba4e439e5e7954ace4d369, State: Running, Role: LEADER
I20260811 01:00:53.475106 21285 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:53.475145 21291 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6167ee98bdba4e439e5e7954ace4d369" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42247 } }
I20260811 01:00:53.475492 21292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6167ee98bdba4e439e5e7954ace4d369" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6167ee98bdba4e439e5e7954ace4d369" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42247 } } }
I20260811 01:00:53.475497 21293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6167ee98bdba4e439e5e7954ace4d369. Latest consensus state: current_term: 1 leader_uuid: "6167ee98bdba4e439e5e7954ace4d369" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6167ee98bdba4e439e5e7954ace4d369" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42247 } } }
I20260811 01:00:53.475607 21292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:53.475611 21293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:53.476300 21306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:53.476836 21306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:53.478417 21306 catalog_manager.cc:1347] Generated new cluster ID: cbda1fcb721d46918081a0207c56a9af
I20260811 01:00:53.478480 21306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:53.491719 21306 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:53.492214 21306 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:53.499672 21306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369: Generated new TSK 0
I20260811 01:00:53.499919 21306 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:00:53.510588 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42247
--builtin_ntp_servers=127.13.30.148:34237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 01:00:53.596573 21323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:53.596797 21323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:53.596838 21323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:53.598133 21323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:53.598182 21323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:53.598220 21323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:00:53.599776 21323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:53.600059 21323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:53.600378 21323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:53.606279 21335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:53.606317 21330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:53.606359 21329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:53.606515 21323 server_base.cc:1034] running on GCE node
I20260811 01:00:53.606769 21323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:53.607010 21323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:53.608160 21323 hybrid_clock.cc:648] HybridClock initialized: now 1786410053608144 us; error 36 us; skew 500 ppm
I20260811 01:00:53.609565 21323 webserver.cc:460] Webserver started at http://127.13.30.129:44763/ using document root <none> and password file <none>
I20260811 01:00:53.609836 21323 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:53.609890 21323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:53.610028 21323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:53.611155 21323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "27042b62be194c7a937a9a95c969a794"
format_stamp: "Formatted at 2026-08-11 01:00:53 on dist-test-slave-42z9"
server_key: "6841d01700ad2f96f48e4cf00fd5e878"
server_key_iv: "86b3ad4735a100a5c60c261055e265be"
server_key_version: "encryptionkey@0"
I20260811 01:00:53.611492 21323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "27042b62be194c7a937a9a95c969a794"
format_stamp: "Formatted at 2026-08-11 01:00:53 on dist-test-slave-42z9"
server_key: "6841d01700ad2f96f48e4cf00fd5e878"
server_key_iv: "86b3ad4735a100a5c60c261055e265be"
server_key_version: "encryptionkey@0"
I20260811 01:00:53.612941 21323 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:53.613687 21342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:53.613853 21323 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:53.613943 21323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "27042b62be194c7a937a9a95c969a794"
format_stamp: "Formatted at 2026-08-11 01:00:53 on dist-test-slave-42z9"
server_key: "6841d01700ad2f96f48e4cf00fd5e878"
server_key_iv: "86b3ad4735a100a5c60c261055e265be"
server_key_version: "encryptionkey@0"
I20260811 01:00:53.614010 21323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:53.617545 21323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:53.617837 21323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:53.617962 21323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:53.618170 21323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:53.618492 21323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:53.618528 21323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:53.618557 21323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:53.618582 21323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:53.624607 21323 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:35579
I20260811 01:00:53.624660 21525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:35579 every 8 connection(s)
I20260811 01:00:53.625015 21323 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:00:53.626802 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 21323
I20260811 01:00:53.626904 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:00:53.627104 13434 external_mini_cluster.cc:1428] Setting key 426bfa3d2a8705bcdea466da25ffc252
I20260811 01:00:53.628175 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42247
--builtin_ntp_servers=127.13.30.148:34237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 01:00:53.628386 21290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.625794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:33847 (local address 127.13.30.190:42247)
0811 01:00:53.625884 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:53.625886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:53.626095 (+ 209us) server_negotiation.cc:407] Connection header received
0811 01:00:53.626577 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:53.626578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:53.626583 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:53.626637 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:53.628105 (+ 1468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:53.628106 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:53.628106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:53.628110 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:53.628126 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:53.628129 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:53.628173 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:53.628278 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 01:00:53.628295 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 01:00:53.628568 21532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.625768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42247 (local address 127.13.30.129:33847)
0811 01:00:53.625974 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:53.626012 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:53.626495 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:53.626718 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:53.626723 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:53.626733 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:53.627922 (+ 1189us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:00:53.627923 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:53.627974 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:00:53.628015 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:53.628179 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:53.628185 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:53.628188 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:00:53.628269 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 01:00:53.628347 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
I20260811 01:00:53.629159 21526 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42247
I20260811 01:00:53.629263 21526 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:53.629419 21526 heartbeater.cc:511] Master 127.13.30.190:42247 requested a full tablet report, sending...
I20260811 01:00:53.630065 21231 ts_manager.cc:194] Registered new tserver with Master: 27042b62be194c7a937a9a95c969a794 (127.13.30.129:35579)
W20260811 01:00:53.712953 21533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:53.713187 21533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:53.713210 21533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:53.714475 21533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:53.714520 21533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:53.714548 21533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:00:53.715969 21533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:53.716197 21533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:53.716482 21533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:53.721782 21542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:53.721752 21545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:53.721939 21533 server_base.cc:1034] running on GCE node
W20260811 01:00:53.722077 21541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:53.722294 21533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:53.722556 21533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:53.723712 21533 hybrid_clock.cc:648] HybridClock initialized: now 1786410053723702 us; error 34 us; skew 500 ppm
I20260811 01:00:53.724975 21533 webserver.cc:460] Webserver started at http://127.13.30.130:33211/ using document root <none> and password file <none>
I20260811 01:00:53.725181 21533 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:53.725222 21533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:53.725323 21533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:53.726575 21533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "75a3b977f291459bbd212e5918e0dd08"
format_stamp: "Formatted at 2026-08-11 01:00:53 on dist-test-slave-42z9"
server_key: "c1530358774572320531b691c3f6a17c"
server_key_iv: "2a081e9ca7996fec5fa53ad448e5b5a9"
server_key_version: "encryptionkey@0"
I20260811 01:00:53.726962 21533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "75a3b977f291459bbd212e5918e0dd08"
format_stamp: "Formatted at 2026-08-11 01:00:53 on dist-test-slave-42z9"
server_key: "c1530358774572320531b691c3f6a17c"
server_key_iv: "2a081e9ca7996fec5fa53ad448e5b5a9"
server_key_version: "encryptionkey@0"
I20260811 01:00:53.728458 21533 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:53.729485 21554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:53.729841 21533 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:53.730041 21533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "75a3b977f291459bbd212e5918e0dd08"
format_stamp: "Formatted at 2026-08-11 01:00:53 on dist-test-slave-42z9"
server_key: "c1530358774572320531b691c3f6a17c"
server_key_iv: "2a081e9ca7996fec5fa53ad448e5b5a9"
server_key_version: "encryptionkey@0"
I20260811 01:00:53.730253 21533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:53.734097 21533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:53.734401 21533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:53.734522 21533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:53.734735 21533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:53.735069 21533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:53.735105 21533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:53.735129 21533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:53.735152 21533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:53.740983 21533 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:36771
I20260811 01:00:53.741056 21737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:36771 every 8 connection(s)
I20260811 01:00:53.741387 21533 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:00:53.743829 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 21533
I20260811 01:00:53.743938 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:00:53.744112 13434 external_mini_cluster.cc:1428] Setting key eb7929725d6f58182f1b9cbbe9dc8b56
I20260811 01:00:53.744597 21290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.742196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:45061 (local address 127.13.30.190:42247)
0811 01:00:53.742248 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:53.742250 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:53.742482 (+ 232us) server_negotiation.cc:407] Connection header received
0811 01:00:53.742994 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:53.742995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:53.743002 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:53.743053 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:53.744331 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:53.744332 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:53.744333 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:53.744338 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:53.744356 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:53.744361 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:53.744428 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:53.744522 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 01:00:53.744538 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 01:00:53.744838 21741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.742172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42247 (local address 127.13.30.130:45061)
0811 01:00:53.742357 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:53.742393 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:53.742893 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:53.743121 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:53.743124 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:53.743134 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:53.744144 (+ 1010us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:00:53.744145 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:53.744185 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:00:53.744226 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:53.744438 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:53.744444 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:53.744447 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:00:53.744530 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 01:00:53.744604 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":88,"threads_started":1}
I20260811 01:00:53.745332 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42247
--builtin_ntp_servers=127.13.30.148:34237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 01:00:53.745338 21739 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42247
I20260811 01:00:53.745472 21739 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:53.745652 21739 heartbeater.cc:511] Master 127.13.30.190:42247 requested a full tablet report, sending...
I20260811 01:00:53.746037 21231 ts_manager.cc:194] Registered new tserver with Master: 75a3b977f291459bbd212e5918e0dd08 (127.13.30.130:36771)
W20260811 01:00:53.832950 21742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:53.833231 21742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:53.833266 21742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:53.834630 21742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:53.834685 21742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:53.834715 21742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:00:53.836308 21742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:53.836544 21742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:53.836848 21742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:53.842233 21756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:53.842278 21754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:53.842242 21759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:53.842494 21742 server_base.cc:1034] running on GCE node
I20260811 01:00:53.842721 21742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:53.842978 21742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:53.844133 21742 hybrid_clock.cc:648] HybridClock initialized: now 1786410053844119 us; error 32 us; skew 500 ppm
I20260811 01:00:53.845578 21742 webserver.cc:460] Webserver started at http://127.13.30.131:35795/ using document root <none> and password file <none>
I20260811 01:00:53.845866 21742 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:53.845917 21742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:53.846021 21742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:53.847159 21742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "a381d68c23dc4b5e975c1515717d26cc"
format_stamp: "Formatted at 2026-08-11 01:00:53 on dist-test-slave-42z9"
server_key: "0916adb5ca667cc9ec8883b6cc8435f1"
server_key_iv: "7f65a0f0812cc51b666330e7b3292217"
server_key_version: "encryptionkey@0"
I20260811 01:00:53.847568 21742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "a381d68c23dc4b5e975c1515717d26cc"
format_stamp: "Formatted at 2026-08-11 01:00:53 on dist-test-slave-42z9"
server_key: "0916adb5ca667cc9ec8883b6cc8435f1"
server_key_iv: "7f65a0f0812cc51b666330e7b3292217"
server_key_version: "encryptionkey@0"
I20260811 01:00:53.849066 21742 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:53.849807 21773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:53.849942 21742 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:53.850026 21742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "a381d68c23dc4b5e975c1515717d26cc"
format_stamp: "Formatted at 2026-08-11 01:00:53 on dist-test-slave-42z9"
server_key: "0916adb5ca667cc9ec8883b6cc8435f1"
server_key_iv: "7f65a0f0812cc51b666330e7b3292217"
server_key_version: "encryptionkey@0"
I20260811 01:00:53.850099 21742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:53.853632 21742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:53.853914 21742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:53.854034 21742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:53.854240 21742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:53.854570 21742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:53.854604 21742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:53.854635 21742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:53.854657 21742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:53.860718 21742 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:43487
I20260811 01:00:53.860770 21956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:43487 every 8 connection(s)
I20260811 01:00:53.861157 21742 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:00:53.861668 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 21742
I20260811 01:00:53.861774 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:00:53.861975 13434 external_mini_cluster.cc:1428] Setting key 233c879fe04c56e3c6a2a99ce6ae1fdb
I20260811 01:00:53.864499 21290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.861982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:42795 (local address 127.13.30.190:42247)
0811 01:00:53.862055 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:53.862058 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:53.862448 (+ 390us) server_negotiation.cc:407] Connection header received
0811 01:00:53.863087 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:53.863088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:53.863094 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:53.863143 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:53.864326 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:53.864327 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:53.864328 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:53.864330 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:53.864341 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:53.864344 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:53.864379 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:53.864428 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 01:00:53.864439 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 01:00:53.864707 21960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.862003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42247 (local address 127.13.30.131:42795)
0811 01:00:53.862313 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:53.862361 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:53.862982 (+ 621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:53.863238 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:53.863242 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:53.863251 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:53.864194 (+ 943us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:00:53.864194 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:53.864227 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:00:53.864258 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:53.864380 (+ 122us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:53.864382 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:53.864385 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:00:53.864436 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 01:00:53.864489 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":88,"threads_started":1}
I20260811 01:00:53.865202 21957 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42247
I20260811 01:00:53.865290 21957 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:53.865479 21957 heartbeater.cc:511] Master 127.13.30.190:42247 requested a full tablet report, sending...
I20260811 01:00:53.865859 21231 ts_manager.cc:194] Registered new tserver with Master: a381d68c23dc4b5e975c1515717d26cc (127.13.30.131:43487)
I20260811 01:00:53.873764 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:00:53.876289 21290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.875229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34722 (local address 127.13.30.190:42247)
0811 01:00:53.875284 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:53.875287 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:53.875404 (+ 117us) server_negotiation.cc:407] Connection header received
0811 01:00:53.875458 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:53.875458 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:53.875465 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:53.875515 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:53.876109 (+ 594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:53.876110 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:53.876111 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:53.876114 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:53.876129 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:53.876134 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:53.876178 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:53.876220 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 01:00:53.876230 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 01:00:53.877924 21231 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:00:53.879554 21231 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:00:53.883612 21970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.881993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:43487 (local address 127.0.0.1:37308)
0811 01:00:53.882536 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:53.882547 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:53.882595 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:53.882853 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:53.882854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:53.882858 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:53.883218 (+ 360us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:00:53.883219 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:53.883225 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:00:53.883235 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:53.883433 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:53.883441 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:53.883444 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:00:53.883516 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 01:00:53.883530 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":74,"threads_started":1}
I20260811 01:00:53.883761 21973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.881889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37684 (local address 127.13.30.129:35579)
0811 01:00:53.882719 (+ 830us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:53.882724 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:53.882735 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:00:53.882763 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:53.882765 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:53.882774 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:53.883055 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:53.883468 (+ 413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:53.883478 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:53.883478 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:53.883482 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:53.883521 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:53.883552 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:53.883609 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:53.883661 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 01:00:53.883676 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":783,"thread_start_us":93,"threads_started":1}
I20260811 01:00:53.883900 21968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.881739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:36771 (local address 127.0.0.1:43470)
0811 01:00:53.882055 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:53.882099 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:53.882171 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:53.882329 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:53.882333 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:53.882341 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:53.882887 (+ 546us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:00:53.882888 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:53.882906 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:00:53.882931 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:53.883770 (+ 839us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:53.883771 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:53.883772 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 01:00:53.883824 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 01:00:53.883839 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":91,"threads_started":1}
I20260811 01:00:53.883934 21974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.881758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:35579 (local address 127.0.0.1:37684)
0811 01:00:53.882114 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:53.882125 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:53.882177 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:53.882891 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:53.882892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:53.882895 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:53.883370 (+ 475us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:00:53.883371 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:53.883376 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:00:53.883385 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:53.883605 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:53.883606 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:53.883606 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 01:00:53.883653 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 01:00:53.883664 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":111,"threads_started":1}
I20260811 01:00:53.883630 21975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.882218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37308 (local address 127.13.30.131:43487)
0811 01:00:53.882415 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:53.882419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:53.882716 (+ 297us) server_negotiation.cc:407] Connection header received
0811 01:00:53.882747 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:53.882749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:53.882759 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:53.882827 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:53.883300 (+ 473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:53.883308 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:53.883308 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:53.883312 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:53.883346 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:53.883373 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:53.883437 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:53.883522 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 01:00:53.883538 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":95,"threads_started":1}
I20260811 01:00:53.884318 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:53.881852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43470 (local address 127.13.30.130:36771)
0811 01:00:53.882049 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:53.882055 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:53.882169 (+ 114us) server_negotiation.cc:407] Connection header received
0811 01:00:53.882225 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:53.882228 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:53.882240 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:53.882311 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:53.883380 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:53.883388 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:53.883388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:53.883394 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:53.883430 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:53.883459 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:53.883522 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:53.883906 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 01:00:53.883923 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":93,"threads_started":1}
I20260811 01:00:53.884732 21427 tablet_service.cc:1467] Processing CreateTablet for tablet 3d120080576d42279ff5bd705e861f4f (DEFAULT_TABLE table=test-table [id=bd5319e96bda4349b66a546f515f228b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:53.884970 21623 tablet_service.cc:1467] Processing CreateTablet for tablet 3d120080576d42279ff5bd705e861f4f (DEFAULT_TABLE table=test-table [id=bd5319e96bda4349b66a546f515f228b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:53.885124 21427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d120080576d42279ff5bd705e861f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:53.885274 21623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d120080576d42279ff5bd705e861f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:53.888029 21982 tablet_bootstrap.cc:492] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794: Bootstrap starting.
I20260811 01:00:53.888383 21844 tablet_service.cc:1467] Processing CreateTablet for tablet 3d120080576d42279ff5bd705e861f4f (DEFAULT_TABLE table=test-table [id=bd5319e96bda4349b66a546f515f228b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:00:53.888696 21844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d120080576d42279ff5bd705e861f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:53.888827 21982 tablet_bootstrap.cc:654] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:53.889135 21982 log.cc:824] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:53.889501 21977 tablet_bootstrap.cc:492] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08: Bootstrap starting.
I20260811 01:00:53.890229 21977 tablet_bootstrap.cc:654] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:53.890513 21977 log.cc:824] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:53.891069 21982 tablet_bootstrap.cc:492] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794: No bootstrap required, opened a new log
I20260811 01:00:53.891136 21982 ts_tablet_manager.cc:1397] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 01:00:53.891291 21977 tablet_bootstrap.cc:492] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08: No bootstrap required, opened a new log
I20260811 01:00:53.891372 21977 ts_tablet_manager.cc:1397] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:00:53.893293 21982 raft_consensus.cc:348] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a3b977f291459bbd212e5918e0dd08" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 36771 } } peers { permanent_uuid: "27042b62be194c7a937a9a95c969a794" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35579 } } peers { permanent_uuid: "a381d68c23dc4b5e975c1515717d26cc" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43487 } }
I20260811 01:00:53.893352 21977 raft_consensus.cc:348] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a3b977f291459bbd212e5918e0dd08" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 36771 } } peers { permanent_uuid: "27042b62be194c7a937a9a95c969a794" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35579 } } peers { permanent_uuid: "a381d68c23dc4b5e975c1515717d26cc" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43487 } }
I20260811 01:00:53.893510 21982 raft_consensus.cc:374] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:53.893556 21982 raft_consensus.cc:729] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27042b62be194c7a937a9a95c969a794, State: Initialized, Role: FOLLOWER
I20260811 01:00:53.893556 21977 raft_consensus.cc:374] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:53.893594 21977 raft_consensus.cc:729] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a3b977f291459bbd212e5918e0dd08, State: Initialized, Role: FOLLOWER
I20260811 01:00:53.893682 21982 consensus_queue.cc:260] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a3b977f291459bbd212e5918e0dd08" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 36771 } } peers { permanent_uuid: "27042b62be194c7a937a9a95c969a794" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35579 } } peers { permanent_uuid: "a381d68c23dc4b5e975c1515717d26cc" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43487 } }
I20260811 01:00:53.893705 21977 consensus_queue.cc:260] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a3b977f291459bbd212e5918e0dd08" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 36771 } } peers { permanent_uuid: "27042b62be194c7a937a9a95c969a794" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35579 } } peers { permanent_uuid: "a381d68c23dc4b5e975c1515717d26cc" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43487 } }
I20260811 01:00:53.893962 21982 ts_tablet_manager.cc:1428] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:00:53.893971 21977 ts_tablet_manager.cc:1428] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:00:53.893971 21526 heartbeater.cc:503] Master 127.13.30.190:42247 was elected leader, sending a full tablet report...
I20260811 01:00:53.894176 21986 tablet_bootstrap.cc:492] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc: Bootstrap starting.
I20260811 01:00:53.894227 21739 heartbeater.cc:503] Master 127.13.30.190:42247 was elected leader, sending a full tablet report...
I20260811 01:00:53.894903 21986 tablet_bootstrap.cc:654] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:53.895246 21986 log.cc:824] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:53.896062 21986 tablet_bootstrap.cc:492] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc: No bootstrap required, opened a new log
I20260811 01:00:53.896121 21986 ts_tablet_manager.cc:1397] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:00:53.898121 21986 raft_consensus.cc:348] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a3b977f291459bbd212e5918e0dd08" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 36771 } } peers { permanent_uuid: "27042b62be194c7a937a9a95c969a794" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35579 } } peers { permanent_uuid: "a381d68c23dc4b5e975c1515717d26cc" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43487 } }
I20260811 01:00:53.898257 21986 raft_consensus.cc:374] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:53.898277 21986 raft_consensus.cc:729] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a381d68c23dc4b5e975c1515717d26cc, State: Initialized, Role: FOLLOWER
I20260811 01:00:53.898393 21986 consensus_queue.cc:260] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a3b977f291459bbd212e5918e0dd08" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 36771 } } peers { permanent_uuid: "27042b62be194c7a937a9a95c969a794" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35579 } } peers { permanent_uuid: "a381d68c23dc4b5e975c1515717d26cc" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43487 } }
I20260811 01:00:53.898640 21986 ts_tablet_manager.cc:1428] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 01:00:53.898689 21957 heartbeater.cc:503] Master 127.13.30.190:42247 was elected leader, sending a full tablet report...
W20260811 01:00:53.992039 21740 tablet.cc:2369] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:00:54.096487 21989 raft_consensus.cc:482] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:00:54.096665 21989 raft_consensus.cc:504] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a3b977f291459bbd212e5918e0dd08" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 36771 } } peers { permanent_uuid: "27042b62be194c7a937a9a95c969a794" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35579 } } peers { permanent_uuid: "a381d68c23dc4b5e975c1515717d26cc" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43487 } }
I20260811 01:00:54.097033 21989 leader_election.cc:288] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75a3b977f291459bbd212e5918e0dd08 (127.13.30.130:36771), a381d68c23dc4b5e975c1515717d26cc (127.13.30.131:43487)
I20260811 01:00:54.098343 21532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:54.097223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:36771 (local address 127.13.30.129:36145)
0811 01:00:54.097302 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:54.097314 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:54.097360 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:54.097561 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:54.097562 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:54.097565 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:54.097995 (+ 430us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:00:54.097995 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:54.098004 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:00:54.098020 (+ 16us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:54.098214 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:54.098215 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:54.098216 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 01:00:54.098261 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 01:00:54.098276 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 01:00:54.098369 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:54.097292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:36145 (local address 127.13.30.130:36771)
0811 01:00:54.097351 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:54.097353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:54.097367 (+ 14us) server_negotiation.cc:407] Connection header received
0811 01:00:54.097429 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:54.097430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:54.097462 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:54.097536 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:54.098108 (+ 572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:54.098110 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:54.098110 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:54.098116 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:54.098134 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:54.098139 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:54.098196 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:54.098272 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 01:00:54.098286 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 01:00:54.098460 21993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:54.097351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:43487 (local address 127.13.30.129:51413)
0811 01:00:54.097539 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:54.097547 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:54.097588 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:54.097707 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:54.097708 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:54.097710 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:54.098137 (+ 427us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:00:54.098137 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:54.098144 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:00:54.098156 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:54.098322 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:54.098323 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:54.098324 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 01:00:54.098368 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 01:00:54.098380 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":129,"threads_started":1}
I20260811 01:00:54.098464 21975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:54.097471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:51413 (local address 127.13.30.131:43487)
0811 01:00:54.097513 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:54.097515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:54.097605 (+ 90us) server_negotiation.cc:407] Connection header received
0811 01:00:54.097639 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:54.097640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:54.097646 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:54.097694 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:54.098232 (+ 538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:54.098233 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:54.098234 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:54.098238 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:54.098258 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:54.098263 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:54.098319 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:54.098369 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 01:00:54.098382 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 01:00:54.098798 21653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d120080576d42279ff5bd705e861f4f" candidate_uuid: "27042b62be194c7a937a9a95c969a794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a3b977f291459bbd212e5918e0dd08" is_pre_election: true
I20260811 01:00:54.098784 21891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d120080576d42279ff5bd705e861f4f" candidate_uuid: "27042b62be194c7a937a9a95c969a794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a381d68c23dc4b5e975c1515717d26cc" is_pre_election: true
I20260811 01:00:54.098958 21653 raft_consensus.cc:2454] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27042b62be194c7a937a9a95c969a794 in term 0.
I20260811 01:00:54.098958 21891 raft_consensus.cc:2454] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27042b62be194c7a937a9a95c969a794 in term 0.
I20260811 01:00:54.099196 21351 leader_election.cc:302] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27042b62be194c7a937a9a95c969a794, 75a3b977f291459bbd212e5918e0dd08; no voters:
I20260811 01:00:54.099345 21989 raft_consensus.cc:2781] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:00:54.099411 21989 raft_consensus.cc:482] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:00:54.099445 21989 raft_consensus.cc:3037] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:54.100206 21989 raft_consensus.cc:504] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a3b977f291459bbd212e5918e0dd08" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 36771 } } peers { permanent_uuid: "27042b62be194c7a937a9a95c969a794" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35579 } } peers { permanent_uuid: "a381d68c23dc4b5e975c1515717d26cc" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43487 } }
I20260811 01:00:54.100339 21989 leader_election.cc:288] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [CANDIDATE]: Term 1 election: Requested vote from peers 75a3b977f291459bbd212e5918e0dd08 (127.13.30.130:36771), a381d68c23dc4b5e975c1515717d26cc (127.13.30.131:43487)
I20260811 01:00:54.100562 21653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d120080576d42279ff5bd705e861f4f" candidate_uuid: "27042b62be194c7a937a9a95c969a794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a3b977f291459bbd212e5918e0dd08"
I20260811 01:00:54.100575 21891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d120080576d42279ff5bd705e861f4f" candidate_uuid: "27042b62be194c7a937a9a95c969a794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a381d68c23dc4b5e975c1515717d26cc"
I20260811 01:00:54.100665 21653 raft_consensus.cc:3037] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:54.100665 21891 raft_consensus.cc:3037] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:54.101668 21891 raft_consensus.cc:2454] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27042b62be194c7a937a9a95c969a794 in term 1.
I20260811 01:00:54.101668 21653 raft_consensus.cc:2454] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27042b62be194c7a937a9a95c969a794 in term 1.
I20260811 01:00:54.101837 21351 leader_election.cc:302] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27042b62be194c7a937a9a95c969a794, 75a3b977f291459bbd212e5918e0dd08; no voters:
I20260811 01:00:54.101948 21989 raft_consensus.cc:2781] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:54.102120 21989 raft_consensus.cc:686] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [term 1 LEADER]: Becoming Leader. State: Replica: 27042b62be194c7a937a9a95c969a794, State: Running, Role: LEADER
I20260811 01:00:54.102231 21989 consensus_queue.cc:237] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a3b977f291459bbd212e5918e0dd08" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 36771 } } peers { permanent_uuid: "27042b62be194c7a937a9a95c969a794" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35579 } } peers { permanent_uuid: "a381d68c23dc4b5e975c1515717d26cc" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43487 } }
I20260811 01:00:54.103083 21231 catalog_manager.cc:5495] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27042b62be194c7a937a9a95c969a794 (127.13.30.129). New cstate: current_term: 1 leader_uuid: "27042b62be194c7a937a9a95c969a794" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a3b977f291459bbd212e5918e0dd08" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 36771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27042b62be194c7a937a9a95c969a794" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a381d68c23dc4b5e975c1515717d26cc" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43487 } health_report { overall_health: UNKNOWN } } }
I20260811 01:00:54.110543 21973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:54.109662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37692 (local address 127.13.30.129:35579)
0811 01:00:54.109717 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:54.109718 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:54.109728 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:00:54.109797 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:54.109798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:54.109811 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:54.109861 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:54.110360 (+ 499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:54.110361 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:54.110361 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:54.110363 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:54.110375 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:54.110378 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:54.110412 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:54.110459 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 01:00:54.110470 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
W20260811 01:00:54.111717 21959 tablet.cc:2369] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:00:54.112396 21891 raft_consensus.cc:1261] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc [term 1 FOLLOWER]: Refusing update from remote peer 27042b62be194c7a937a9a95c969a794: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:54.112444 21653 raft_consensus.cc:1261] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08 [term 1 FOLLOWER]: Refusing update from remote peer 27042b62be194c7a937a9a95c969a794: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:00:54.112761 21989 consensus_queue.cc:1035] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a3b977f291459bbd212e5918e0dd08" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 36771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:54.112910 21995 consensus_queue.cc:1035] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a381d68c23dc4b5e975c1515717d26cc" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:00:54.115538 21999 mvcc.cc:205] Tried to move back new op lower bound from 7317135581641572352 to 7317135581603328000. Current Snapshot: MvccSnapshot[applied={T|T < 7317135581641572352}]
I20260811 01:00:54.117686 21231 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:54.117789 21231 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:00:54.118568 21231 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6167ee98bdba4e439e5e7954ace4d369: Sending DeleteTablet for 3 replicas of tablet 3d120080576d42279ff5bd705e861f4f
I20260811 01:00:54.118964 21623 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d120080576d42279ff5bd705e861f4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:54 UTC) from {username='slave'} at 127.0.0.1:43470
I20260811 01:00:54.118973 21844 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d120080576d42279ff5bd705e861f4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:54 UTC) from {username='slave'} at 127.0.0.1:37308
I20260811 01:00:54.119217 22011 tablet_replica.cc:330] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc: stopping tablet replica
I20260811 01:00:54.119205 21427 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d120080576d42279ff5bd705e861f4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:00:54 UTC) from {username='slave'} at 127.0.0.1:37684
I20260811 01:00:54.119359 22011 raft_consensus.cc:2229] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:54.119484 22011 raft_consensus.cc:2258] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:54.119537 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 21323
I20260811 01:00:54.119494 22014 tablet_replica.cc:330] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794: stopping tablet replica
I20260811 01:00:54.119663 22013 tablet_replica.cc:330] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08: stopping tablet replica
I20260811 01:00:54.119768 22013 raft_consensus.cc:2229] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:00:54.119809 22014 raft_consensus.cc:2229] T 3d120080576d42279ff5bd705e861f4f P 27042b62be194c7a937a9a95c969a794 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:00:54.119889 22013 raft_consensus.cc:2258] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:00:54.120404 22011 ts_tablet_manager.cc:1905] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:54.121752 22011 ts_tablet_manager.cc:1918] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:00:54.121837 22011 log.cc:1196] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/3d120080576d42279ff5bd705e861f4f
I20260811 01:00:54.122068 22011 ts_tablet_manager.cc:1939] T 3d120080576d42279ff5bd705e861f4f P a381d68c23dc4b5e975c1515717d26cc: Deleting consensus metadata
I20260811 01:00:54.122541 21212 catalog_manager.cc:4841] TS a381d68c23dc4b5e975c1515717d26cc (127.13.30.131:43487): tablet 3d120080576d42279ff5bd705e861f4f (table test-table [id=bd5319e96bda4349b66a546f515f228b]) successfully deleted
I20260811 01:00:54.122678 22013 ts_tablet_manager.cc:1905] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:00:54.123891 22013 ts_tablet_manager.cc:1918] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:00:54.123965 22013 log.cc:1196] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/3d120080576d42279ff5bd705e861f4f
I20260811 01:00:54.124183 22013 ts_tablet_manager.cc:1939] T 3d120080576d42279ff5bd705e861f4f P 75a3b977f291459bbd212e5918e0dd08: Deleting consensus metadata
I20260811 01:00:54.124611 21212 catalog_manager.cc:4841] TS 75a3b977f291459bbd212e5918e0dd08 (127.13.30.130:36771): tablet 3d120080576d42279ff5bd705e861f4f (table test-table [id=bd5319e96bda4349b66a546f515f228b]) successfully deleted
W20260811 01:00:54.135195 21204 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:35579 (error 108)
I20260811 01:00:54.135407 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 21533
I20260811 01:00:54.142362 21974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:54.138441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:35579 (local address 127.0.0.1:37708)
0811 01:00:54.142209 (+ 3768us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:54.142302 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:35579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3727}
W20260811 01:00:54.142724 21204 catalog_manager.cc:4584] TS 27042b62be194c7a937a9a95c969a794 (127.13.30.129:35579): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3d120080576d42279ff5bd705e861f4f: Network error: Client connection negotiation failed: client connection to 127.13.30.129:35579: connect: Connection refused (error 111)
I20260811 01:00:54.152522 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 21742
I20260811 01:00:54.164937 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 21176
2026-08-11T01:00:54Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (844 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 01:00:54.192108 13434 mini_oidc.cc:152] Starting JWKS server
I20260811 01:00:54.193337 13434 webserver.cc:460] Webserver started at https://127.0.0.1:38971/ using document root <none> and password file <none>
I20260811 01:00:54.193424 13434 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 01:00:54.193625 13434 webserver.cc:460] Webserver started at http://127.0.0.1:34945/ using document root <none> and password file <none>
2026-08-11T01:00:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:54Z Disabled control of system clock
I20260811 01:00:54.202831 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:37399
--webserver_interface=127.13.30.190
--webserver_port=0
--builtin_ntp_servers=127.13.30.148:38697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:37399
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38971/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/testchainca.cert with env {}
W20260811 01:00:54.287544 22028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:54.287777 22028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:54.287809 22028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:54.289057 22028 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:54.289103 22028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:54.289120 22028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:54.289136 22028 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:54.289151 22028 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 01:00:54.289167 22028 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 01:00:54.289189 22028 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38971/jwks.json
I20260811 01:00:54.290930 22028 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:38697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:37399
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:37399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38971/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:54.291203 22028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:54.291409 22028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:54.296627 22039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:54.296629 22035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:54.296661 22028 server_base.cc:1034] running on GCE node
W20260811 01:00:54.296628 22034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:54.297204 22028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:54.297567 22028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:54.298720 22028 hybrid_clock.cc:648] HybridClock initialized: now 1786410054298704 us; error 36 us; skew 500 ppm
I20260811 01:00:54.300087 22028 webserver.cc:460] Webserver started at http://127.13.30.190:43293/ using document root <none> and password file <none>
I20260811 01:00:54.300324 22028 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:54.300377 22028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:54.300519 22028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:54.301708 22028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "f1ece715133041ca8879b24274a7c780"
format_stamp: "Formatted at 2026-08-11 01:00:54 on dist-test-slave-42z9"
server_key: "b166568fec959421689d4079f36b4b2f"
server_key_iv: "4d6814bced0da4648c8921dc180b472d"
server_key_version: "encryptionkey@0"
I20260811 01:00:54.302165 22028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "f1ece715133041ca8879b24274a7c780"
format_stamp: "Formatted at 2026-08-11 01:00:54 on dist-test-slave-42z9"
server_key: "b166568fec959421689d4079f36b4b2f"
server_key_iv: "4d6814bced0da4648c8921dc180b472d"
server_key_version: "encryptionkey@0"
I20260811 01:00:54.303773 22028 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:00:54.304605 22046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:54.304768 22028 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:54.304859 22028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "f1ece715133041ca8879b24274a7c780"
format_stamp: "Formatted at 2026-08-11 01:00:54 on dist-test-slave-42z9"
server_key: "b166568fec959421689d4079f36b4b2f"
server_key_iv: "4d6814bced0da4648c8921dc180b472d"
server_key_version: "encryptionkey@0"
I20260811 01:00:54.304929 22028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:54.331745 22028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:54.332098 22028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:54.332238 22028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:54.336283 22028 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:37399
I20260811 01:00:54.336326 22142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:37399 every 8 connection(s)
I20260811 01:00:54.336692 22028 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:54.337906 22143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:54.338380 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 22028
I20260811 01:00:54.338495 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:54.338649 13434 external_mini_cluster.cc:1428] Setting key 9b4c7ca5c6bfbe0b42b76a53d9416105
I20260811 01:00:54.341239 22143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780: Bootstrap starting.
I20260811 01:00:54.342166 22143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:54.342475 22143 log.cc:824] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:54.343317 22143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780: No bootstrap required, opened a new log
I20260811 01:00:54.344823 22147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:54.339217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58390 (local address 127.13.30.190:37399)
0811 01:00:54.339461 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:54.339470 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:54.339507 (+ 37us) server_negotiation.cc:407] Connection header received
0811 01:00:54.340061 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:54.340070 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:54.340159 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:54.340325 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:54.340494 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.341858 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.342697 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.343230 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.343362 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:54.344055 (+ 693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:54.344059 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:54.344060 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:54.344296 (+ 236us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:54.344340 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:54.344357 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:54.344435 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:54.344493 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 01:00:54.344587 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":102,"threads_started":1}
I20260811 01:00:54.345744 22143 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ece715133041ca8879b24274a7c780" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37399 } }
I20260811 01:00:54.345888 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:54.345937 22143 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:54.345978 22143 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1ece715133041ca8879b24274a7c780, State: Initialized, Role: FOLLOWER
I20260811 01:00:54.346091 22143 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ece715133041ca8879b24274a7c780" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37399 } }
I20260811 01:00:54.346161 22143 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:54.346189 22143 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:54.346231 22143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:54.347046 22143 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ece715133041ca8879b24274a7c780" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37399 } }
I20260811 01:00:54.347142 22143 leader_election.cc:302] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1ece715133041ca8879b24274a7c780; no voters:
I20260811 01:00:54.347285 22143 leader_election.cc:288] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:54.347347 22149 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:54.347501 22149 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [term 1 LEADER]: Becoming Leader. State: Replica: f1ece715133041ca8879b24274a7c780, State: Running, Role: LEADER
I20260811 01:00:54.347601 22143 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:54.347623 22149 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ece715133041ca8879b24274a7c780" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37399 } }
I20260811 01:00:54.347990 22150 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1ece715133041ca8879b24274a7c780" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ece715133041ca8879b24274a7c780" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37399 } } }
I20260811 01:00:54.348090 22150 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:54.347996 22151 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1ece715133041ca8879b24274a7c780. Latest consensus state: current_term: 1 leader_uuid: "f1ece715133041ca8879b24274a7c780" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ece715133041ca8879b24274a7c780" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37399 } } }
I20260811 01:00:54.348490 22151 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:54.348721 22161 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:54.349228 22161 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:54.350924 22161 catalog_manager.cc:1347] Generated new cluster ID: f6acae249b0d4f3c861fb06c5ba8c720
I20260811 01:00:54.350979 22161 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:54.360821 22161 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:54.361421 22161 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:54.364435 22161 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1ece715133041ca8879b24274a7c780: Generated new TSK 0
I20260811 01:00:54.364645 22161 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 01:00:54.400266 22183 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 01:00:54.400511 22183 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 01:00:54.400692 22147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:54.377226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58404 (local address 127.13.30.190:37399)
0811 01:00:54.377289 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:54.377292 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:54.377472 (+ 180us) server_negotiation.cc:407] Connection header received
0811 01:00:54.377610 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:54.377611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:54.377624 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:54.377686 (+ 62us) server_negotiation.cc:226] Negotiated authn=JWT
0811 01:00:54.377854 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.378386 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.379519 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.379709 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.379757 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:54.380035 (+ 278us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 01:00:54.400236 (+ 20201us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 01:00:54.400515 (+ 279us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58404: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":31}
W20260811 01:00:54.400795 22147 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58404: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 01:00:54.401049 22182 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:54.377149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37399 (local address 127.0.0.1:58404)
0811 01:00:54.377374 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:54.377386 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:54.377505 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:54.377708 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:54.377709 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:54.377711 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 01:00:54.377792 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:54.377794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.378462 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.378463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:54.379429 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:54.379433 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.379789 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.379790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:54.379871 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:54.379902 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 01:00:54.400417 (+ 20515us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 01:00:54.400588 (+ 171us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.30.190:37399: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":88,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.13.30.190:37399: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 01:00:54.401504 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 22028
2026-08-11T01:00:54Z chronyd exiting
I20260811 01:00:54.467746 13434 test_util.cc:175] -----------------------------------------------
I20260811 01:00:54.467840 13434 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786410030080353-13434-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (277 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 01:00:54.468753 13434 mini_oidc.cc:152] Starting JWKS server
I20260811 01:00:54.469507 13434 webserver.cc:460] Webserver started at https://127.0.0.1:34101/ using document root <none> and password file <none>
I20260811 01:00:54.469565 13434 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 01:00:54.469723 13434 webserver.cc:460] Webserver started at http://127.0.0.1:36803/ using document root <none> and password file <none>
2026-08-11T01:00:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:54Z Disabled control of system clock
I20260811 01:00:54.479493 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:38793
--webserver_interface=127.13.30.190
--webserver_port=0
--builtin_ntp_servers=127.13.30.148:38269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:38793
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34101/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/testchainca.cert with env {}
W20260811 01:00:54.564308 22191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:54.564530 22191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:54.564561 22191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:54.565824 22191 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:54.565874 22191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:54.565891 22191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:54.565907 22191 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:54.565924 22191 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 01:00:54.565948 22191 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 01:00:54.565972 22191 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34101/jwks.json
I20260811 01:00:54.567643 22191 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:38269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:38793
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:38793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34101/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:54.567937 22191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:54.568159 22191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:54.573505 22205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:54.573542 22202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:54.573683 22191 server_base.cc:1034] running on GCE node
W20260811 01:00:54.573499 22200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:54.574031 22191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:54.574343 22191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:54.575489 22191 hybrid_clock.cc:648] HybridClock initialized: now 1786410054575473 us; error 33 us; skew 500 ppm
I20260811 01:00:54.576785 22191 webserver.cc:460] Webserver started at http://127.13.30.190:40221/ using document root <none> and password file <none>
I20260811 01:00:54.577047 22191 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:54.577107 22191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:54.577244 22191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:54.578575 22191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "8aa42c8920894e8ba1ca69107c146ff1"
format_stamp: "Formatted at 2026-08-11 01:00:54 on dist-test-slave-42z9"
server_key: "ef5254c4f27a23ffff28cc50ad84477e"
server_key_iv: "f4663f56277983a28cdb57c51442488c"
server_key_version: "encryptionkey@0"
I20260811 01:00:54.578909 22191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "8aa42c8920894e8ba1ca69107c146ff1"
format_stamp: "Formatted at 2026-08-11 01:00:54 on dist-test-slave-42z9"
server_key: "ef5254c4f27a23ffff28cc50ad84477e"
server_key_iv: "f4663f56277983a28cdb57c51442488c"
server_key_version: "encryptionkey@0"
I20260811 01:00:54.580322 22191 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 01:00:54.581086 22213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:54.581270 22191 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:54.581364 22191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "8aa42c8920894e8ba1ca69107c146ff1"
format_stamp: "Formatted at 2026-08-11 01:00:54 on dist-test-slave-42z9"
server_key: "ef5254c4f27a23ffff28cc50ad84477e"
server_key_iv: "f4663f56277983a28cdb57c51442488c"
server_key_version: "encryptionkey@0"
I20260811 01:00:54.581431 22191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:54.593716 22191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:54.594056 22191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:54.594170 22191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:54.598347 22191 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:38793
I20260811 01:00:54.598402 22287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:38793 every 8 connection(s)
I20260811 01:00:54.598755 22191 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:54.599510 22288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:54.602726 22288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1: Bootstrap starting.
I20260811 01:00:54.603434 22288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:54.603694 22288 log.cc:824] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:54.604485 22288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1: No bootstrap required, opened a new log
I20260811 01:00:54.604512 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 22191
I20260811 01:00:54.604601 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:54.604790 13434 external_mini_cluster.cc:1428] Setting key c5787eeed85009d5d502e67a87ae6d54
I20260811 01:00:54.606554 22288 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aa42c8920894e8ba1ca69107c146ff1" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38793 } }
I20260811 01:00:54.606724 22288 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:54.606761 22288 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa42c8920894e8ba1ca69107c146ff1, State: Initialized, Role: FOLLOWER
I20260811 01:00:54.606957 22288 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aa42c8920894e8ba1ca69107c146ff1" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38793 } }
I20260811 01:00:54.607049 22288 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:54.607074 22288 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:54.607121 22288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:54.607728 22288 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aa42c8920894e8ba1ca69107c146ff1" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38793 } }
I20260811 01:00:54.607832 22288 leader_election.cc:302] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8aa42c8920894e8ba1ca69107c146ff1; no voters:
I20260811 01:00:54.608016 22288 leader_election.cc:288] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:54.608052 22295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:54.608207 22295 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [term 1 LEADER]: Becoming Leader. State: Replica: 8aa42c8920894e8ba1ca69107c146ff1, State: Running, Role: LEADER
I20260811 01:00:54.608310 22288 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:54.608417 22295 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aa42c8920894e8ba1ca69107c146ff1" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38793 } }
I20260811 01:00:54.608868 22296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8aa42c8920894e8ba1ca69107c146ff1. Latest consensus state: current_term: 1 leader_uuid: "8aa42c8920894e8ba1ca69107c146ff1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aa42c8920894e8ba1ca69107c146ff1" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38793 } } }
I20260811 01:00:54.608963 22296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:54.609102 22297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8aa42c8920894e8ba1ca69107c146ff1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aa42c8920894e8ba1ca69107c146ff1" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38793 } } }
I20260811 01:00:54.609153 22297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:54.609254 22307 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:54.609870 22307 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:54.611853 22293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:54.605347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55282 (local address 127.13.30.190:38793)
0811 01:00:54.605564 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:54.605571 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:54.605597 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:00:54.606509 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:54.606515 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:54.606589 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:54.606713 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:54.607001 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.608530 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.609657 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.610273 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.610396 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:54.611086 (+ 690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:54.611091 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:54.611092 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:54.611306 (+ 214us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:54.611363 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:54.611380 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:54.611452 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:54.611535 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 01:00:54.611626 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":68,"threads_started":1}
I20260811 01:00:54.612310 22307 catalog_manager.cc:1347] Generated new cluster ID: 28e2f2c14e184acebdbf10351d603bea
I20260811 01:00:54.612373 22307 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:54.612754 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:54.624114 22307 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:54.624900 22307 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:54.632426 22307 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8aa42c8920894e8ba1ca69107c146ff1: Generated new TSK 0
I20260811 01:00:54.632654 22307 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 01:00:54.657869 22334 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 01:00:54.657961 22334 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 01:00:54.658393 22293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:54.642892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55288 (local address 127.13.30.190:38793)
0811 01:00:54.642985 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:54.642988 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:54.643120 (+ 132us) server_negotiation.cc:407] Connection header received
0811 01:00:54.643238 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:54.643239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:54.643255 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:54.643351 (+ 96us) server_negotiation.cc:226] Negotiated authn=JWT
0811 01:00:54.643565 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.644354 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.645154 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.645516 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.645592 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:54.645802 (+ 210us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 01:00:54.658116 (+ 12314us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34101/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 01:00:54.658301 (+ 185us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55288: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34101/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 01:00:54.658460 22293 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55288: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34101/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 01:00:54.658464 22333 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:54.642745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:38793 (local address 127.0.0.1:55288)
0811 01:00:54.643032 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:54.643043 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:54.643122 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:54.643402 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:54.643403 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:54.643407 (+ 4us) client_negotiation.cc:189] Negotiated authn=JWT
0811 01:00:54.643479 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:54.643481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.644448 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.644449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:54.645069 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:54.645071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.645615 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.645616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:54.645678 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:54.645685 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 01:00:54.658253 (+ 12568us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34101/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 01:00:54.658383 (+ 130us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.30.190:38793: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34101/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":171,"threads_started":1}
I20260811 01:00:54.658905 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 22191
2026-08-11T01:00:54Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (238 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 01:00:54.706899 13434 mini_oidc.cc:152] Starting JWKS server
I20260811 01:00:54.707615 13434 webserver.cc:460] Webserver started at https://127.0.0.1:42671/ using document root <none> and password file <none>
I20260811 01:00:54.707660 13434 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 01:00:54.707772 13434 webserver.cc:460] Webserver started at http://127.0.0.1:42499/ using document root <none> and password file <none>
2026-08-11T01:00:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:54Z Disabled control of system clock
I20260811 01:00:54.717679 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:46025
--webserver_interface=127.13.30.190
--webserver_port=0
--builtin_ntp_servers=127.13.30.148:34797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:46025
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42671/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 01:00:54.801812 22342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:54.802044 22342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:54.802068 22342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:54.803344 22342 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:54.803395 22342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:54.803407 22342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:54.803418 22342 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:54.803429 22342 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 01:00:54.803440 22342 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 01:00:54.803450 22342 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42671/jwks.json
I20260811 01:00:54.804955 22342 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:46025
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:46025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42671/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:54.805246 22342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:54.805619 22342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:54.810640 22350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:54.810626 22349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:54.810626 22353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:54.810824 22342 server_base.cc:1034] running on GCE node
I20260811 01:00:54.811161 22342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:54.811474 22342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:54.812624 22342 hybrid_clock.cc:648] HybridClock initialized: now 1786410054812610 us; error 29 us; skew 500 ppm
I20260811 01:00:54.814054 22342 webserver.cc:460] Webserver started at http://127.13.30.190:41383/ using document root <none> and password file <none>
I20260811 01:00:54.814291 22342 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:54.814342 22342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:54.814445 22342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:54.815613 22342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "4697db84d2014051a8965f3b50308bf3"
format_stamp: "Formatted at 2026-08-11 01:00:54 on dist-test-slave-42z9"
server_key: "0947871bd83065a1e934cb790dad04ef"
server_key_iv: "3a76cc5b095660c506af87df8fc33eaf"
server_key_version: "encryptionkey@0"
I20260811 01:00:54.816007 22342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "4697db84d2014051a8965f3b50308bf3"
format_stamp: "Formatted at 2026-08-11 01:00:54 on dist-test-slave-42z9"
server_key: "0947871bd83065a1e934cb790dad04ef"
server_key_iv: "3a76cc5b095660c506af87df8fc33eaf"
server_key_version: "encryptionkey@0"
I20260811 01:00:54.817489 22342 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260811 01:00:54.818221 22360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:54.818397 22342 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:54.818491 22342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "4697db84d2014051a8965f3b50308bf3"
format_stamp: "Formatted at 2026-08-11 01:00:54 on dist-test-slave-42z9"
server_key: "0947871bd83065a1e934cb790dad04ef"
server_key_iv: "3a76cc5b095660c506af87df8fc33eaf"
server_key_version: "encryptionkey@0"
I20260811 01:00:54.818563 22342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:54.835425 22342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:54.835804 22342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:54.835951 22342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:54.840095 22342 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:46025
I20260811 01:00:54.840139 22449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:46025 every 8 connection(s)
I20260811 01:00:54.840495 22342 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:54.841230 22452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:54.842787 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 22342
I20260811 01:00:54.842895 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:54.843092 13434 external_mini_cluster.cc:1428] Setting key 236dad31f21a4f8bc31ee15327872ec5
I20260811 01:00:54.844743 22452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3: Bootstrap starting.
I20260811 01:00:54.845566 22452 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:54.845862 22452 log.cc:824] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:54.846587 22452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3: No bootstrap required, opened a new log
I20260811 01:00:54.848392 22452 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4697db84d2014051a8965f3b50308bf3" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46025 } }
I20260811 01:00:54.848568 22452 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:54.848631 22452 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4697db84d2014051a8965f3b50308bf3, State: Initialized, Role: FOLLOWER
I20260811 01:00:54.848830 22457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:54.843662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52198 (local address 127.13.30.190:46025)
0811 01:00:54.843853 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:54.843861 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:54.843889 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:00:54.844573 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:54.844582 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:54.844654 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:54.844784 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:54.845041 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.846044 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.846859 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.847281 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.847395 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:54.848064 (+ 669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:54.848068 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:54.848068 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:54.848236 (+ 168us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:54.848269 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:54.848281 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:54.848334 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:54.848420 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 01:00:54.848506 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
I20260811 01:00:54.848829 22452 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4697db84d2014051a8965f3b50308bf3" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46025 } }
I20260811 01:00:54.848970 22452 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:54.849014 22452 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:54.849062 22452 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:54.849835 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:54.849928 22452 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4697db84d2014051a8965f3b50308bf3" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46025 } }
I20260811 01:00:54.850039 22452 leader_election.cc:302] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4697db84d2014051a8965f3b50308bf3; no voters:
I20260811 01:00:54.850214 22452 leader_election.cc:288] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:54.850298 22459 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:54.850512 22452 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:54.850514 22459 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [term 1 LEADER]: Becoming Leader. State: Replica: 4697db84d2014051a8965f3b50308bf3, State: Running, Role: LEADER
I20260811 01:00:54.850921 22459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4697db84d2014051a8965f3b50308bf3" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46025 } }
I20260811 01:00:54.851387 22459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4697db84d2014051a8965f3b50308bf3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4697db84d2014051a8965f3b50308bf3" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46025 } } }
I20260811 01:00:54.851468 22459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:54.851621 22459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4697db84d2014051a8965f3b50308bf3. Latest consensus state: current_term: 1 leader_uuid: "4697db84d2014051a8965f3b50308bf3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4697db84d2014051a8965f3b50308bf3" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46025 } } }
I20260811 01:00:54.851708 22472 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:54.851720 22459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:54.852454 22472 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:54.853958 22472 catalog_manager.cc:1347] Generated new cluster ID: c1d89e24cf2e420fbf6bca924ce2a564
I20260811 01:00:54.854012 22472 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:54.870849 22472 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:54.871400 22472 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:54.877625 22472 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4697db84d2014051a8965f3b50308bf3: Generated new TSK 0
I20260811 01:00:54.877836 22472 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:00:54.893509 22457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:54.889498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52212 (local address 127.13.30.190:46025)
0811 01:00:54.889554 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:54.889557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:54.889710 (+ 153us) server_negotiation.cc:407] Connection header received
0811 01:00:54.889802 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:54.889803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:54.889815 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:54.889886 (+ 71us) server_negotiation.cc:226] Negotiated authn=JWT
0811 01:00:54.890049 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.890555 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.891765 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.891976 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.892021 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:54.892230 (+ 209us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 01:00:54.893221 (+ 991us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42671/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 01:00:54.893375 (+ 154us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52212: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42671/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 01:00:54.893589 22457 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52212: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42671/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 01:00:54.894012 22495 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:54.889409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:46025 (local address 127.0.0.1:52212)
0811 01:00:54.889621 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:54.889635 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:54.889720 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:54.889898 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:54.889900 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:54.889902 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 01:00:54.889972 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:54.889974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.890664 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.890665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:54.891661 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:54.891666 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:54.892050 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:54.892051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:54.892119 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:54.892128 (+ 9us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 01:00:54.893342 (+ 1214us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42671/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 01:00:54.893516 (+ 174us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.30.190:46025: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42671/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":135,"threads_started":1}
I20260811 01:00:54.894291 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 22342
E20260811 01:00:54.914783 22496 webserver.cc:533] Webserver: sslize failed:
E20260811 01:00:54.914893 22496 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T01:00:54Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (246 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T01:00:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:54Z Disabled control of system clock
I20260811 01:00:54.962743 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:38517
--webserver_interface=127.13.30.190
--webserver_port=0
--builtin_ntp_servers=127.13.30.148:40641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:38517
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/testchainca.cert with env {}
W20260811 01:00:55.048750 22503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:55.049011 22503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:55.049039 22503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:55.050688 22503 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:55.050763 22503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:55.050776 22503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:55.050788 22503 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:55.050804 22503 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 01:00:55.050824 22503 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 01:00:55.050840 22503 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 01:00:55.052809 22503 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:40641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:38517
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:38517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22503
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:55.053112 22503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:55.053354 22503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:55.058681 22511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:55.058681 22515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:55.058691 22513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:55.059077 22503 server_base.cc:1034] running on GCE node
I20260811 01:00:55.059351 22503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:55.059676 22503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:55.060817 22503 hybrid_clock.cc:648] HybridClock initialized: now 1786410055060809 us; error 31 us; skew 500 ppm
I20260811 01:00:55.062369 22503 webserver.cc:460] Webserver started at http://127.13.30.190:39333/ using document root <none> and password file <none>
I20260811 01:00:55.062619 22503 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:55.062673 22503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:55.062817 22503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:55.064075 22503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "aa284b83010d4fa4b60ddeb4f3af1456"
format_stamp: "Formatted at 2026-08-11 01:00:55 on dist-test-slave-42z9"
server_key: "f0b4ebbd73a7c78639babb09d0df75a0"
server_key_iv: "55769c12294eca5716fd4025c20ca65e"
server_key_version: "encryptionkey@0"
I20260811 01:00:55.064495 22503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "aa284b83010d4fa4b60ddeb4f3af1456"
format_stamp: "Formatted at 2026-08-11 01:00:55 on dist-test-slave-42z9"
server_key: "f0b4ebbd73a7c78639babb09d0df75a0"
server_key_iv: "55769c12294eca5716fd4025c20ca65e"
server_key_version: "encryptionkey@0"
I20260811 01:00:55.066220 22503 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 01:00:55.067078 22524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:55.067257 22503 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:55.067351 22503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "aa284b83010d4fa4b60ddeb4f3af1456"
format_stamp: "Formatted at 2026-08-11 01:00:55 on dist-test-slave-42z9"
server_key: "f0b4ebbd73a7c78639babb09d0df75a0"
server_key_iv: "55769c12294eca5716fd4025c20ca65e"
server_key_version: "encryptionkey@0"
I20260811 01:00:55.067420 22503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:55.092679 22503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:55.093070 22503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:55.093220 22503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:55.097357 22503 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:38517
I20260811 01:00:55.097402 22620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:38517 every 8 connection(s)
I20260811 01:00:55.097805 22503 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:55.098249 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 22503
I20260811 01:00:55.098371 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:55.098575 13434 external_mini_cluster.cc:1428] Setting key da9ec197598dedac13909123faf55f8a
I20260811 01:00:55.099119 22621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:55.102435 22621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456: Bootstrap starting.
I20260811 01:00:55.103266 22621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:55.103614 22621 log.cc:824] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:55.104326 22625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:55.099152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34668 (local address 127.13.30.190:38517)
0811 01:00:55.099385 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:55.099393 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:55.099420 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:00:55.099886 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:55.099894 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:55.099958 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:55.100078 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:55.100314 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:55.101198 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:55.102314 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:55.102795 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:55.102900 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:55.103637 (+ 737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:55.103641 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:55.103642 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:00:55.103838 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:55.103885 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:00:55.103902 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:55.103968 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:55.104049 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 01:00:55.104142 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":94,"threads_started":1}
I20260811 01:00:55.104539 22621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456: No bootstrap required, opened a new log
I20260811 01:00:55.105290 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:00:55.106832 22621 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa284b83010d4fa4b60ddeb4f3af1456" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38517 } }
I20260811 01:00:55.106993 22621 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:55.107028 22621 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa284b83010d4fa4b60ddeb4f3af1456, State: Initialized, Role: FOLLOWER
I20260811 01:00:55.107146 22621 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa284b83010d4fa4b60ddeb4f3af1456" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38517 } }
I20260811 01:00:55.107213 22621 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:55.107244 22621 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:55.107292 22621 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:00:55.107987 22621 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa284b83010d4fa4b60ddeb4f3af1456" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38517 } }
I20260811 01:00:55.108093 22621 leader_election.cc:302] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa284b83010d4fa4b60ddeb4f3af1456; no voters:
I20260811 01:00:55.108266 22621 leader_election.cc:288] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:55.108345 22633 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:55.108549 22621 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:55.108547 22633 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [term 1 LEADER]: Becoming Leader. State: Replica: aa284b83010d4fa4b60ddeb4f3af1456, State: Running, Role: LEADER
I20260811 01:00:55.108681 22633 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa284b83010d4fa4b60ddeb4f3af1456" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38517 } }
I20260811 01:00:55.109081 22635 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa284b83010d4fa4b60ddeb4f3af1456" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa284b83010d4fa4b60ddeb4f3af1456" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38517 } } }
I20260811 01:00:55.109097 22636 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa284b83010d4fa4b60ddeb4f3af1456. Latest consensus state: current_term: 1 leader_uuid: "aa284b83010d4fa4b60ddeb4f3af1456" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa284b83010d4fa4b60ddeb4f3af1456" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38517 } } }
I20260811 01:00:55.109189 22635 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:55.109192 22636 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:55.109421 22647 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:55.109988 22647 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:55.111687 22647 catalog_manager.cc:1347] Generated new cluster ID: 638158d745694c7d81f150148dc9b126
I20260811 01:00:55.111747 22647 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:55.117290 22647 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:55.117864 22647 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:55.127198 22647 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa284b83010d4fa4b60ddeb4f3af1456: Generated new TSK 0
I20260811 01:00:55.127417 22647 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:00:55.212965 22625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:55.139331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34684 (local address 127.13.30.190:38517)
0811 01:00:55.139384 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:55.139386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:55.139421 (+ 35us) server_negotiation.cc:407] Connection header received
0811 01:00:55.139523 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:55.139524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:55.139536 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:55.139601 (+ 65us) server_negotiation.cc:226] Negotiated authn=JWT
0811 01:00:55.139743 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:55.140283 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:55.141475 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:55.141677 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:55.141728 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:55.141914 (+ 186us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 01:00:55.212695 (+ 70781us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 01:00:55.212896 (+ 201us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34684: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 01:00:55.213068 22625 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34684: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 01:00:55.213176 22671 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:55.139177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:38517 (local address 127.0.0.1:34684)
0811 01:00:55.139352 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:55.139364 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:55.139441 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:55.139613 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:55.139613 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:55.139616 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0811 01:00:55.139685 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:55.139688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:55.140366 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:55.140367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:55.141355 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:55.141359 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:55.141747 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:55.141748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:55.141812 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:55.141819 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 01:00:55.212888 (+ 71069us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 01:00:55.213061 (+ 173us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.30.190:38517: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":115,"threads_started":1}
I20260811 01:00:55.213658 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 22503
2026-08-11T01:00:55Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (293 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (96 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (96 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:55 dist-test-slave-42z9 krb5kdc[22689](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:55 dist-test-slave-42z9 krb5kdc[22689](info): set up 2 sockets
Aug 11 01:00:55 dist-test-slave-42z9 krb5kdc[22689](info): commencing operation
krb5kdc: starting...
W20260811 01:00:56.600854 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:00:56 dist-test-slave-42z9 krb5kdc[22689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:00:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:00:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:00:56.736370 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:41509
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:34611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:41509
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:56.826507 22710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:56.826771 22710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:56.826797 22710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:56.828106 22710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:00:56.828154 22710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:56.828168 22710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:56.828181 22710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:00:56.828190 22710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:00:56.829952 22710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:41509
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:41509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:56.830224 22710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:56.830443 22710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:56.836041 22725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:56.836041 22718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:56.836081 22720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:56.836422 22710 server_base.cc:1034] running on GCE node
I20260811 01:00:56.836741 22710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:56.837116 22710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:56.838302 22710 hybrid_clock.cc:648] HybridClock initialized: now 1786410056838279 us; error 41 us; skew 500 ppm
Aug 11 01:00:56 dist-test-slave-42z9 krb5kdc[22689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410056, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:56.841094 22710 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:00:56.841639 22710 webserver.cc:460] Webserver started at http://127.13.30.190:35031/ using document root <none> and password file <none>
I20260811 01:00:56.841869 22710 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:56.841924 22710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:56.842059 22710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:56.843245 22710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "6e26fd87b43a4d998c36a0461e815a61"
format_stamp: "Formatted at 2026-08-11 01:00:56 on dist-test-slave-42z9"
server_key: "f3c7f24e54ed531277e8a8a81f18db58"
server_key_iv: "477893150571ed054ba949d013cc9a89"
server_key_version: "encryptionkey@0"
I20260811 01:00:56.843750 22710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "6e26fd87b43a4d998c36a0461e815a61"
format_stamp: "Formatted at 2026-08-11 01:00:56 on dist-test-slave-42z9"
server_key: "f3c7f24e54ed531277e8a8a81f18db58"
server_key_iv: "477893150571ed054ba949d013cc9a89"
server_key_version: "encryptionkey@0"
I20260811 01:00:56.845181 22710 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:56.846261 22735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:56.846489 22710 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 01:00:56.846601 22710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "6e26fd87b43a4d998c36a0461e815a61"
format_stamp: "Formatted at 2026-08-11 01:00:56 on dist-test-slave-42z9"
server_key: "f3c7f24e54ed531277e8a8a81f18db58"
server_key_iv: "477893150571ed054ba949d013cc9a89"
server_key_version: "encryptionkey@0"
I20260811 01:00:56.846678 22710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:56.863986 22710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:56.866359 22710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:56.866508 22710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:56.870831 22710 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:41509
I20260811 01:00:56.870869 22827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:41509 every 8 connection(s)
I20260811 01:00:56.871239 22710 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:00:56.872210 22829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:00:56.872912 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 22710
I20260811 01:00:56.873021 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:00:56.873219 13434 external_mini_cluster.cc:1428] Setting key d9edd8647ec779385dc282823532f172
I20260811 01:00:56.875411 22829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61: Bootstrap starting.
I20260811 01:00:56.876083 22829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61: Neither blocks nor log segments found. Creating new log.
I20260811 01:00:56.876358 22829 log.cc:824] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61: Log is configured to *not* fsync() on all Append() calls
I20260811 01:00:56.877189 22829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61: No bootstrap required, opened a new log
I20260811 01:00:56.879786 22829 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e26fd87b43a4d998c36a0461e815a61" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41509 } }
I20260811 01:00:56.879972 22829 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:00:56.879997 22829 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e26fd87b43a4d998c36a0461e815a61, State: Initialized, Role: FOLLOWER
I20260811 01:00:56.880115 22829 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e26fd87b43a4d998c36a0461e815a61" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41509 } }
I20260811 01:00:56.880190 22829 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:00:56.880215 22829 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:00:56.880263 22829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 01:00:56 dist-test-slave-42z9 krb5kdc[22689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:56.880957 22829 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e26fd87b43a4d998c36a0461e815a61" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41509 } }
I20260811 01:00:56.881060 22829 leader_election.cc:302] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e26fd87b43a4d998c36a0461e815a61; no voters:
I20260811 01:00:56.881270 22829 leader_election.cc:288] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:00:56.881326 22837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:00:56.881680 22829 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:00:56.881925 22837 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [term 1 LEADER]: Becoming Leader. State: Replica: 6e26fd87b43a4d998c36a0461e815a61, State: Running, Role: LEADER
I20260811 01:00:56.882975 22837 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e26fd87b43a4d998c36a0461e815a61" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41509 } }
I20260811 01:00:56.883675 22840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e26fd87b43a4d998c36a0461e815a61. Latest consensus state: current_term: 1 leader_uuid: "6e26fd87b43a4d998c36a0461e815a61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e26fd87b43a4d998c36a0461e815a61" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41509 } } }
I20260811 01:00:56.883710 22838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e26fd87b43a4d998c36a0461e815a61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e26fd87b43a4d998c36a0461e815a61" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41509 } } }
I20260811 01:00:56.883786 22840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [sys.catalog]: This master's current role is: LEADER
I20260811 01:00:56.883807 22838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61 [sys.catalog]: This master's current role is: LEADER
W20260811 01:00:56.884362 22862 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:00:56.884455 22862 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:00:56.884557 22864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:00:56.884739 22834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:56.873816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42218 (local address 127.13.30.190:41509)
0811 01:00:56.874005 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:56.874014 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:56.874041 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:00:56.874488 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:56.874495 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:56.874545 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:56.874663 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:56.875460 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:56.876471 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:56.877529 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:56.877954 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:56.878047 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:56.880909 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:56.880914 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:56.880915 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:56.880930 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:56.882957 (+ 2027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:56.883367 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:56.883370 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:56.883370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:56.883488 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:56.883701 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:56.883701 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:56.883702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:56.884055 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:56.884219 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:56.884375 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 01:00:56.884532 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":77,"threads_started":1}
I20260811 01:00:56.884775 22864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:00:56.886431 22864 catalog_manager.cc:1347] Generated new cluster ID: 61b52c03bc844a2ba13133636200dac0
I20260811 01:00:56.886489 22864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:00:56.893908 22864 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:00:56.894573 22864 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:00:56.900187 22864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e26fd87b43a4d998c36a0461e815a61: Generated new TSK 0
I20260811 01:00:56.900446 22864 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
W20260811 01:00:57.222355 13434 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.13.30.129: real 0.315s user 0.000s sys 0.004s
I20260811 01:00:57.222747 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41509
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:34611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:57.310348 22870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:57.310588 22870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:57.310616 22870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:57.311862 22870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:57.311923 22870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:57.311950 22870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:00:57.313625 22870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:57.313915 22870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:57.314182 22870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:57.319662 22884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:57.319617 22878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:57.319751 22870 server_base.cc:1034] running on GCE node
W20260811 01:00:57.319617 22881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:57.320127 22870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:57.320384 22870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:57.321529 22870 hybrid_clock.cc:648] HybridClock initialized: now 1786410057321514 us; error 28 us; skew 500 ppm
Aug 11 01:00:57 dist-test-slave-42z9 krb5kdc[22689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410057, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:57.324229 22870 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:00:57.324707 22870 webserver.cc:460] Webserver started at http://127.13.30.129:37465/ using document root <none> and password file <none>
I20260811 01:00:57.324947 22870 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:57.325007 22870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:57.325141 22870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:57.326274 22870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "ae6de5a179744f30b0baf4ce4cc4b87a"
format_stamp: "Formatted at 2026-08-11 01:00:57 on dist-test-slave-42z9"
server_key: "a044864723668675dae90643f5e3e34c"
server_key_iv: "cdbba7ac3154569c185327407a28d1b6"
server_key_version: "encryptionkey@0"
I20260811 01:00:57.326632 22870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "ae6de5a179744f30b0baf4ce4cc4b87a"
format_stamp: "Formatted at 2026-08-11 01:00:57 on dist-test-slave-42z9"
server_key: "a044864723668675dae90643f5e3e34c"
server_key_iv: "cdbba7ac3154569c185327407a28d1b6"
server_key_version: "encryptionkey@0"
I20260811 01:00:57.328070 22870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 01:00:57.328882 22895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:57.329071 22870 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:00:57.329165 22870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "ae6de5a179744f30b0baf4ce4cc4b87a"
format_stamp: "Formatted at 2026-08-11 01:00:57 on dist-test-slave-42z9"
server_key: "a044864723668675dae90643f5e3e34c"
server_key_iv: "cdbba7ac3154569c185327407a28d1b6"
server_key_version: "encryptionkey@0"
I20260811 01:00:57.329236 22870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:57.346810 22870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:57.349121 22870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:57.349284 22870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:57.349548 22870 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:57.349881 22870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:57.349937 22870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:57.349997 22870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:57.350018 22870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:57.357182 22870 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:40653
I20260811 01:00:57.357244 23108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:40653 every 8 connection(s)
I20260811 01:00:57.357635 22870 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:00:57.359331 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 22870
I20260811 01:00:57.359440 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:00:57.359642 13434 external_mini_cluster.cc:1428] Setting key 8a6eac6d094cac5ff0c32c69dfc9c966
Aug 11 01:00:57 dist-test-slave-42z9 krb5kdc[22689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410057, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
I20260811 01:00:57.369737 22834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:57.358565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:56007 (local address 127.13.30.190:41509)
0811 01:00:57.358626 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:57.358628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:57.358896 (+ 268us) server_negotiation.cc:407] Connection header received
0811 01:00:57.360302 (+ 1406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:57.360304 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:57.360318 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:57.360368 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:57.361088 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:57.361645 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:57.362683 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:57.362894 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:57.362949 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:57.366319 (+ 3370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:57.366322 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:57.366322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:57.366333 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:57.368158 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:57.368642 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:57.368644 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:57.368644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:57.368736 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:57.368977 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:57.368978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:57.368978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:57.369140 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:57.369212 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:57.369508 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 01:00:57.369628 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 01:00:57.370061 23113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:57.358405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41509 (local address 127.13.30.129:56007)
0811 01:00:57.358678 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:57.358760 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:57.360168 (+ 1408us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:57.360478 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:57.360483 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:57.360781 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:57.360985 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:57.360989 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:57.361738 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:57.361739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:57.362597 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:57.362600 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:57.363261 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:57.363262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:57.363435 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:57.364007 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:57.364018 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:57.366184 (+ 2166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:57.368267 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:57.368278 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:57.368280 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:57.368555 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:57.368804 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:57.368805 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:57.368805 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:57.368911 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:57.369208 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:57.369212 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:57.369348 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 01:00:57.369430 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 01:00:57.369681 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":85,"threads_started":1}
I20260811 01:00:57.370605 23111 heartbeater.cc:347] Connected to a master server at 127.13.30.190:41509
I20260811 01:00:57.370725 23111 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:57.370961 23111 heartbeater.cc:511] Master 127.13.30.190:41509 requested a full tablet report, sending...
I20260811 01:00:57.371536 22768 ts_manager.cc:194] Registered new tserver with Master: ae6de5a179744f30b0baf4ce4cc4b87a (127.13.30.129:40653)
I20260811 01:00:57.372162 22768 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:56007
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
W20260811 01:00:58.149957 13434 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.13.30.130: real 0.789s user 0.000s sys 0.004s
I20260811 01:00:58.150665 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41509
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:34611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:58.242404 23117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:58.242660 23117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:58.242689 23117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:58.244079 23117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:58.244138 23117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:58.244169 23117 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:00:58.245920 23117 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:58.246222 23117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:58.246492 23117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:00:58.252838 23117 server_base.cc:1034] running on GCE node
W20260811 01:00:58.252861 23133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:58.252866 23130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:58.253032 23131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:58.253317 23117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:58.253650 23117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:58.254850 23117 hybrid_clock.cc:648] HybridClock initialized: now 1786410058254810 us; error 51 us; skew 500 ppm
Aug 11 01:00:58 dist-test-slave-42z9 krb5kdc[22689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410058, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:58.258260 23117 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:00:58.258811 23117 webserver.cc:460] Webserver started at http://127.13.30.130:35325/ using document root <none> and password file <none>
I20260811 01:00:58.259049 23117 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:58.259102 23117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:58.259243 23117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:58.260428 23117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "20297ef4a16248708ff3e5136517f878"
format_stamp: "Formatted at 2026-08-11 01:00:58 on dist-test-slave-42z9"
server_key: "bdb535f60af58ce9b2d5fe4f8e0e6dad"
server_key_iv: "551aa18d5cab4d002e7bca3779d0e9db"
server_key_version: "encryptionkey@0"
I20260811 01:00:58.260802 23117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "20297ef4a16248708ff3e5136517f878"
format_stamp: "Formatted at 2026-08-11 01:00:58 on dist-test-slave-42z9"
server_key: "bdb535f60af58ce9b2d5fe4f8e0e6dad"
server_key_iv: "551aa18d5cab4d002e7bca3779d0e9db"
server_key_version: "encryptionkey@0"
I20260811 01:00:58.262460 23117 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:58.263306 23143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:58.263470 23117 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:00:58.263569 23117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "20297ef4a16248708ff3e5136517f878"
format_stamp: "Formatted at 2026-08-11 01:00:58 on dist-test-slave-42z9"
server_key: "bdb535f60af58ce9b2d5fe4f8e0e6dad"
server_key_iv: "551aa18d5cab4d002e7bca3779d0e9db"
server_key_version: "encryptionkey@0"
I20260811 01:00:58.263656 23117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:58.284580 23117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:58.287261 23117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:58.287427 23117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:58.287746 23117 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:58.288106 23117 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:58.288151 23117 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:58.288185 23117 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:58.288201 23117 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:58.294275 23117 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:39895
I20260811 01:00:58.294348 23346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:39895 every 8 connection(s)
I20260811 01:00:58.294708 23117 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:00:58.297691 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 23117
I20260811 01:00:58.297814 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:00:58.298022 13434 external_mini_cluster.cc:1428] Setting key 979f1fdc20dfa6c398ffd465a4244787
Aug 11 01:00:58 dist-test-slave-42z9 krb5kdc[22689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410058, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:58.306277 23352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:58.295650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:49431 (local address 127.13.30.190:41509)
0811 01:00:58.295846 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:58.295849 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:58.295999 (+ 150us) server_negotiation.cc:407] Connection header received
0811 01:00:58.297177 (+ 1178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:58.297179 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:58.297198 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:58.297266 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:58.298262 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:58.298937 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:58.300019 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:58.300233 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:58.300292 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:58.302847 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:58.302849 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:58.302850 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:58.302860 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:58.304560 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:58.305150 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:58.305152 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:58.305152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:58.305225 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:58.305563 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:58.305564 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:58.305564 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:58.305705 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:58.305765 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:58.306116 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 01:00:58.306196 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":70,"threads_started":1}
I20260811 01:00:58.306576 23351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:58.295508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41509 (local address 127.13.30.130:49431)
0811 01:00:58.295777 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:58.295872 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:58.296989 (+ 1117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:58.297358 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:58.297362 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:58.297824 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:58.298140 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:58.298148 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:58.299038 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:58.299040 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:58.299916 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:58.299919 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:58.300313 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:58.300314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:58.300448 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:58.300984 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:58.300993 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:58.302710 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:58.304673 (+ 1963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:58.304684 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:58.304687 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:58.305043 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:58.305302 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:58.305303 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:58.305303 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:58.305497 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:58.305771 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:58.305777 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:58.305975 (+ 198us) client_negotiation.cc:769] Sending connection context
0811 01:00:58.306094 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 01:00:58.306295 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":94,"threads_started":1}
I20260811 01:00:58.307153 23347 heartbeater.cc:347] Connected to a master server at 127.13.30.190:41509
I20260811 01:00:58.307262 23347 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:58.307472 23347 heartbeater.cc:511] Master 127.13.30.190:41509 requested a full tablet report, sending...
I20260811 01:00:58.307889 22768 ts_manager.cc:194] Registered new tserver with Master: 20297ef4a16248708ff3e5136517f878 (127.13.30.130:39895)
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
I20260811 01:00:58.308398 22768 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:49431
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
I20260811 01:00:58.373234 23111 heartbeater.cc:503] Master 127.13.30.190:41509 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
W20260811 01:00:58.780515 13434 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.13.30.131: real 0.482s user 0.001s sys 0.003s
I20260811 01:00:58.780915 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41509
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:34611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:00:58.867874 23355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:00:58.868116 23355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:00:58.868144 23355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:00:58.869499 23355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:00:58.869556 23355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:00:58.869585 23355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:00:58.871272 23355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:00:58.871555 23355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:00:58.871795 23355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:00:58.877126 23367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:58.877416 23355 server_base.cc:1034] running on GCE node
W20260811 01:00:58.877337 23365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:00:58.877328 23364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:00:58.877848 23355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:00:58.878116 23355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:00:58.879277 23355 hybrid_clock.cc:648] HybridClock initialized: now 1786410058879265 us; error 34 us; skew 500 ppm
Aug 11 01:00:58 dist-test-slave-42z9 krb5kdc[22689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410058, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:58.882148 23355 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:00:58.882762 23355 webserver.cc:460] Webserver started at http://127.13.30.131:36013/ using document root <none> and password file <none>
I20260811 01:00:58.882984 23355 fs_manager.cc:359] Metadata directory not provided
I20260811 01:00:58.883026 23355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:00:58.883132 23355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:00:58.884238 23355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "edca516337654ad19d7f1d2a2c039fa8"
format_stamp: "Formatted at 2026-08-11 01:00:58 on dist-test-slave-42z9"
server_key: "c8e1fdbe7630b2f7830a4f57f8107819"
server_key_iv: "078a2f347ac3dcc88fe7b65fd084d7a5"
server_key_version: "encryptionkey@0"
I20260811 01:00:58.884563 23355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "edca516337654ad19d7f1d2a2c039fa8"
format_stamp: "Formatted at 2026-08-11 01:00:58 on dist-test-slave-42z9"
server_key: "c8e1fdbe7630b2f7830a4f57f8107819"
server_key_iv: "078a2f347ac3dcc88fe7b65fd084d7a5"
server_key_version: "encryptionkey@0"
I20260811 01:00:58.886129 23355 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:00:58.887079 23379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:58.887310 23355 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:00:58.887413 23355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "edca516337654ad19d7f1d2a2c039fa8"
format_stamp: "Formatted at 2026-08-11 01:00:58 on dist-test-slave-42z9"
server_key: "c8e1fdbe7630b2f7830a4f57f8107819"
server_key_iv: "078a2f347ac3dcc88fe7b65fd084d7a5"
server_key_version: "encryptionkey@0"
I20260811 01:00:58.887497 23355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:00:58.936615 23355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:00:58.938772 23355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:00:58.938933 23355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:00:58.939185 23355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:00:58.939523 23355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:00:58.939584 23355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:58.939616 23355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:00:58.939633 23355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:00:58.945433 23355 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:35637
I20260811 01:00:58.945559 23574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:35637 every 8 connection(s)
I20260811 01:00:58.945883 23355 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:00:58.948037 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 23355
I20260811 01:00:58.948154 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:00:58.948328 13434 external_mini_cluster.cc:1428] Setting key e2cbd7945c1a98dda920657dd23a5233
Aug 11 01:00:58 dist-test-slave-42z9 krb5kdc[22689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410058, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:00:58.955713 23580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:58.946670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41509 (local address 127.13.30.131:41303)
0811 01:00:58.946842 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 01:00:58.946888 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:00:58.947821 (+ 933us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:00:58.948201 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:00:58.948207 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:00:58.948571 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:00:58.948876 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:58.948883 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:58.949721 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:58.949722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:58.950624 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:00:58.950628 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:00:58.950973 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:00:58.950974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:00:58.951082 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:58.951668 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:00:58.951677 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:00:58.953099 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:00:58.954468 (+ 1369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:58.954475 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:58.954476 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:58.954698 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:58.954848 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:00:58.954848 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:00:58.954849 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:00:58.954941 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:00:58.955137 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:00:58.955140 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:00:58.955265 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 01:00:58.955348 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 01:00:58.955524 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":73,"threads_started":1}
I20260811 01:00:58.955790 23587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:58.946705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:41303 (local address 127.13.30.190:41509)
0811 01:00:58.946852 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:58.946855 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:58.946972 (+ 117us) server_negotiation.cc:407] Connection header received
0811 01:00:58.947949 (+ 977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:58.947950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:58.947965 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:58.948103 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:58.948972 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:58.949645 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:58.950691 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:58.950898 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:58.950954 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:58.953193 (+ 2239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:58.953194 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:58.953195 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:58.953202 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:58.954389 (+ 1187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:58.954755 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:58.954756 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:58.954756 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:58.954804 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:58.954985 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:58.954985 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:58.954986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:58.955094 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:58.955140 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:58.955519 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 01:00:58.955683 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":65,"threads_started":1}
I20260811 01:00:58.956523 23577 heartbeater.cc:347] Connected to a master server at 127.13.30.190:41509
I20260811 01:00:58.956653 23577 heartbeater.cc:464] Registering TS with master...
I20260811 01:00:58.956859 23577 heartbeater.cc:511] Master 127.13.30.190:41509 requested a full tablet report, sending...
I20260811 01:00:58.957278 22768 ts_manager.cc:194] Registered new tserver with Master: edca516337654ad19d7f1d2a2c039fa8 (127.13.30.131:35637)
I20260811 01:00:58.957702 22768 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:41303
I20260811 01:00:58.960495 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/test-admin.keytab.
Aug 11 01:00:58 dist-test-slave-42z9 krb5kdc[22689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:58.977908 13434 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 01:00:58.979995 23598 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:58.979087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41314 (local address 127.13.30.129:40653)
0811 01:00:58.979349 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:58.979356 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:58.979371 (+ 15us) server_negotiation.cc:407] Connection header received
0811 01:00:58.979403 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:58.979406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:58.979424 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:58.979507 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:58.979902 (+ 395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41314: BlockingRecv error: recv got EOF from 127.0.0.1:41314 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":64,"threads_started":1}
W20260811 01:00:58.980146 13434 init.cc:244] Error while opening credential cache '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/krb5cc)
Aug 11 01:00:58 dist-test-slave-42z9 krb5kdc[22689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:58.981201 13434 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 01:00:58 dist-test-slave-42z9 krb5kdc[22689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:58.982151 13434 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 01:00:58 dist-test-slave-42z9 krb5kdc[22689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.129@KRBTEST.COM
I20260811 01:00:58.990623 23598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:58.982820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41316 (local address 127.13.30.129:40653)
0811 01:00:58.982881 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:58.982883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:58.982937 (+ 54us) server_negotiation.cc:407] Connection header received
0811 01:00:58.982996 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:58.982997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:58.983008 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:58.983056 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:58.983425 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:58.984157 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:58.984859 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:58.985179 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:58.985232 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:58.987359 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:58.987371 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:58.987371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:58.987380 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:58.989018 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:58.989361 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:58.989364 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:58.989364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:58.989432 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:58.989835 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:58.989835 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:58.989836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:58.989994 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:58.990133 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:58.990420 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 01:00:58.990516 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
W20260811 01:00:58.992736 23598 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:58.992091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41332 (local address 127.13.30.129:40653)
0811 01:00:58.992142 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:58.992144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:58.992163 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:00:58.992219 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:58.992220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:58.992230 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:58.992275 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:58.992694 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41332: BlockingRecv error: recv got EOF from 127.0.0.1:41332 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260811 01:00:58.992806 13434 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/krb5cc' of type FILE
Aug 11 01:00:58 dist-test-slave-42z9 krb5kdc[22689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:58.993835 13434 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 01:00:58 dist-test-slave-42z9 krb5kdc[22689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:58.994956 13434 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 01:00:58 dist-test-slave-42z9 krb5kdc[22689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.129@KRBTEST.COM
I20260811 01:00:59.003598 23598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:58.995661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41348 (local address 127.13.30.129:40653)
0811 01:00:58.995743 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:58.995745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:58.995772 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:00:58.995792 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:58.995793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:58.995801 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:58.995844 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:58.996247 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:58.996748 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:58.997680 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:58.997902 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:58.997973 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:59.000574 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:59.000576 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:59.000576 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:59.000585 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:59.001943 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:59.002335 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:59.002336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:59.002336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:59.002416 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:59.002858 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:59.002860 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:59.002860 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:59.003028 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:59.003153 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:59.003373 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 01:00:59.003491 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 01:00:59.005558 23598 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:00:59.004791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41354 (local address 127.13.30.129:40653)
0811 01:00:59.004891 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:59.004894 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:59.004908 (+ 14us) server_negotiation.cc:407] Connection header received
0811 01:00:59.004987 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:59.004989 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:59.005002 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:59.005065 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:59.005504 (+ 439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41354: BlockingRecv error: recv got EOF from 127.0.0.1:41354 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260811 01:00:59.005630 13434 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786410030080353-13434-0/krb5kdc/krb5cc' of type FILE
Aug 11 01:00:59 dist-test-slave-42z9 krb5kdc[22689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:59.006686 13434 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 01:00:59 dist-test-slave-42z9 krb5kdc[22689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:00:59.007786 13434 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 01:00:59 dist-test-slave-42z9 krb5kdc[22689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.129@KRBTEST.COM
I20260811 01:00:59.015655 23598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:00:59.008468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41356 (local address 127.13.30.129:40653)
0811 01:00:59.008546 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 01:00:59.008547 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:00:59.008651 (+ 104us) server_negotiation.cc:407] Connection header received
0811 01:00:59.008686 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:00:59.008687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:00:59.008699 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:00:59.008757 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:00:59.009168 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:59.009757 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:59.010505 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:00:59.010687 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:00:59.010731 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:00:59.012938 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:00:59.012941 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:00:59.012942 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:00:59.012952 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:00:59.014659 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:59.015021 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:59.015022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:59.015023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:59.015080 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:00:59.015224 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:00:59.015224 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:00:59.015224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:00:59.015328 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:00:59.015401 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 01:00:59.015498 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 01:00:59.015564 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 01:00:59.016572 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 22870
I20260811 01:00:59.046633 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 23117
I20260811 01:00:59.068953 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 23355
I20260811 01:00:59.098642 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 22710
2026-08-11T01:00:59Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3687 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:00:59 dist-test-slave-42z9 krb5kdc[23619](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:00:59 dist-test-slave-42z9 krb5kdc[23619](info): set up 2 sockets
Aug 11 01:00:59 dist-test-slave-42z9 krb5kdc[23619](info): commencing operation
krb5kdc: starting...
W20260811 01:01:00.302346 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:01:00 dist-test-slave-42z9 krb5kdc[23619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:01:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:01:00Z Disabled control of system clock
WARNING: no policy specified for oryx/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.190.keytab.
Entry for principal oryx/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.190.keytab.
I20260811 01:01:00.436702 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:45431
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.190.keytab
--principal=oryx/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:44177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:45431
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:00.524097 23644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:00.524353 23644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:00.524379 23644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:00.525635 23644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:01:00.525676 23644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:00.525688 23644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:00.525700 23644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:01:00.525712 23644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:01:00.527331 23644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:44177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:45431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.190.keytab
--principal=oryx/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:45431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:00.527572 23644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:00.527781 23644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:00.533146 23656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:00.533181 23644 server_base.cc:1034] running on GCE node
W20260811 01:01:00.533161 23653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:00.533160 23651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:00.533743 23644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:00.534096 23644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:00.535274 23644 hybrid_clock.cc:648] HybridClock initialized: now 1786410060535256 us; error 39 us; skew 500 ppm
Aug 11 01:01:00 dist-test-slave-42z9 krb5kdc[23619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410060, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:00.542392 23644 init.cc:377] Logged in from keytab as oryx/127.13.30.190@KRBTEST.COM (short username oryx)
I20260811 01:01:00.542950 23644 webserver.cc:460] Webserver started at http://127.13.30.190:36915/ using document root <none> and password file <none>
I20260811 01:01:00.543200 23644 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:00.543253 23644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:00.543388 23644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:00.544526 23644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "515d747c628940349bea50bbfcd1e591"
format_stamp: "Formatted at 2026-08-11 01:01:00 on dist-test-slave-42z9"
server_key: "2b75322584011133bb2fbd8293aa7741"
server_key_iv: "fb10b85d3e49d0dd0f2906fadd356d1d"
server_key_version: "encryptionkey@0"
I20260811 01:01:00.544893 23644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "515d747c628940349bea50bbfcd1e591"
format_stamp: "Formatted at 2026-08-11 01:01:00 on dist-test-slave-42z9"
server_key: "2b75322584011133bb2fbd8293aa7741"
server_key_iv: "fb10b85d3e49d0dd0f2906fadd356d1d"
server_key_version: "encryptionkey@0"
I20260811 01:01:00.546384 23644 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260811 01:01:00.547197 23665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:00.547616 23644 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:00.547821 23644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "515d747c628940349bea50bbfcd1e591"
format_stamp: "Formatted at 2026-08-11 01:01:00 on dist-test-slave-42z9"
server_key: "2b75322584011133bb2fbd8293aa7741"
server_key_iv: "fb10b85d3e49d0dd0f2906fadd356d1d"
server_key_version: "encryptionkey@0"
I20260811 01:01:00.547953 23644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:00.562420 23644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:00.564585 23644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:00.564750 23644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:00.569262 23644 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:45431
I20260811 01:01:00.569305 23751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:45431 every 8 connection(s)
I20260811 01:01:00.569727 23644 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:01:00.570822 23752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:00.573325 23752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591: Bootstrap starting.
I20260811 01:01:00.573324 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 23644
I20260811 01:01:00.573469 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:01:00.573647 13434 external_mini_cluster.cc:1428] Setting key 015f180fae2b3b19910597a8b9805d6b
I20260811 01:01:00.574106 23752 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:00.574489 23752 log.cc:824] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:00.575467 23752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591: No bootstrap required, opened a new log
I20260811 01:01:00.577720 23752 raft_consensus.cc:348] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } }
I20260811 01:01:00.577962 23752 raft_consensus.cc:374] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:00.578007 23752 raft_consensus.cc:729] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 515d747c628940349bea50bbfcd1e591, State: Initialized, Role: FOLLOWER
I20260811 01:01:00.578155 23752 consensus_queue.cc:260] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } }
I20260811 01:01:00.578249 23752 raft_consensus.cc:388] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:01:00.578285 23752 raft_consensus.cc:482] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:01:00.578329 23752 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:00.579074 23752 raft_consensus.cc:504] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } }
I20260811 01:01:00.579177 23752 leader_election.cc:302] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 515d747c628940349bea50bbfcd1e591; no voters:
I20260811 01:01:00.579444 23752 leader_election.cc:288] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:01:00.579504 23760 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:01:00.579661 23760 raft_consensus.cc:686] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [term 1 LEADER]: Becoming Leader. State: Replica: 515d747c628940349bea50bbfcd1e591, State: Running, Role: LEADER
I20260811 01:01:00.579753 23760 consensus_queue.cc:237] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } }
I20260811 01:01:00.579793 23752 sys_catalog.cc:564] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:01:00.580915 23761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } }
I20260811 01:01:00.581027 23761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:00.581259 23763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 515d747c628940349bea50bbfcd1e591. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } }
I20260811 01:01:00.581295 23780 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:01:00.581326 23763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: This master's current role is: LEADER
Aug 11 01:01:00 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:00.581854 23780 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:01:00.583925 23780 catalog_manager.cc:1347] Generated new cluster ID: aaf8e0969b664caf9eb6b9ac9ddd232b
I20260811 01:01:00.583983 23780 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:01:00.586210 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:00.574214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33696 (local address 127.13.30.190:45431)
0811 01:01:00.574405 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:00.574413 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:00.574440 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:01:00.575051 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:00.575063 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:00.575140 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:00.575275 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:00.576202 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:00.577347 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:00.578630 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:00.579123 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:00.579252 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:00.582288 (+ 3036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:00.582293 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:00.582294 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:00.582308 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:00.584366 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:00.584818 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:00.584822 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:00.584822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:00.584942 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:00.585144 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:00.585145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:00.585145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:00.585535 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:00.585712 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:00.585798 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 01:01:00.585971 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":79,"threads_started":1}
I20260811 01:01:00.590758 23780 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:01:00.591312 23780 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:01:00.593412 23780 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591: Generated new TSK 0
I20260811 01:01:00.593640 23780 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.129.keytab.
Entry for principal oryx/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.129.keytab.
I20260811 01:01:00.626752 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45431
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.129.keytab
--principal=oryx/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:44177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:00.712679 23802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:00.712998 23802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:00.713043 23802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:00.714529 23802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:00.714591 23802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:00.714622 23802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:01:00.716286 23802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:44177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.129.keytab
--principal=oryx/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:00.716535 23802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:00.716753 23802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:00.722150 23811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:00.722154 23812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:00.722183 23816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:00.722589 23802 server_base.cc:1034] running on GCE node
I20260811 01:01:00.722826 23802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:00.723058 23802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:00.724220 23802 hybrid_clock.cc:648] HybridClock initialized: now 1786410060724205 us; error 27 us; skew 500 ppm
Aug 11 01:01:00 dist-test-slave-42z9 krb5kdc[23619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410060, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:00.727035 23802 init.cc:377] Logged in from keytab as oryx/127.13.30.129@KRBTEST.COM (short username oryx)
I20260811 01:01:00.727519 23802 webserver.cc:460] Webserver started at http://127.13.30.129:42987/ using document root <none> and password file <none>
I20260811 01:01:00.727772 23802 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:00.727819 23802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:00.727941 23802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:00.729014 23802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "3277febdecd149e0bd31853aefb16946"
format_stamp: "Formatted at 2026-08-11 01:01:00 on dist-test-slave-42z9"
server_key: "3df2b81bb06d2c6dfc64b3567370b65d"
server_key_iv: "bae1f94b3039ffba4350af14a968eab7"
server_key_version: "encryptionkey@0"
I20260811 01:01:00.729393 23802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "3277febdecd149e0bd31853aefb16946"
format_stamp: "Formatted at 2026-08-11 01:01:00 on dist-test-slave-42z9"
server_key: "3df2b81bb06d2c6dfc64b3567370b65d"
server_key_iv: "bae1f94b3039ffba4350af14a968eab7"
server_key_version: "encryptionkey@0"
I20260811 01:01:00.730928 23802 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:00.731657 23826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:00.731817 23802 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:00.731907 23802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "3277febdecd149e0bd31853aefb16946"
format_stamp: "Formatted at 2026-08-11 01:01:00 on dist-test-slave-42z9"
server_key: "3df2b81bb06d2c6dfc64b3567370b65d"
server_key_iv: "bae1f94b3039ffba4350af14a968eab7"
server_key_version: "encryptionkey@0"
I20260811 01:01:00.731977 23802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:00.749266 23802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:00.751751 23802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:00.751905 23802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:00.752142 23802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:00.752486 23802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:00.752523 23802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:00.752554 23802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:00.752578 23802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:00.758375 23802 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:36911
I20260811 01:01:00.758447 24029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:36911 every 8 connection(s)
I20260811 01:01:00.758834 23802 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:01:00.763077 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 23802
I20260811 01:01:00.763177 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:01:00.763370 13434 external_mini_cluster.cc:1428] Setting key 17d892319a470647d64e997c595a9c77
Aug 11 01:01:00 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410060, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:00.768716 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:00.759569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:60689 (local address 127.13.30.190:45431)
0811 01:01:00.759634 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:00.759636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:00.759831 (+ 195us) server_negotiation.cc:407] Connection header received
0811 01:01:00.760355 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:00.760356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:00.760369 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:00.760434 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:00.761414 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:00.761970 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:00.762987 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:00.763243 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:00.763309 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:00.765812 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:00.765815 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:00.765815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:00.765824 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:00.767183 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:00.767626 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:00.767627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:00.767627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:00.767674 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:00.768001 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:00.768002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:00.768002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:00.768125 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:00.768179 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:00.768530 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 01:01:00.768626 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 01:01:00.768950 24034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:00.759540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.129:60689)
0811 01:01:00.759709 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:00.759747 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:00.760253 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:00.760510 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:00.760513 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:00.761106 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:00.761309 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:00.761313 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:00.762060 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:00.762061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:00.762891 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:00.762894 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:00.763326 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:00.763327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:00.763505 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:00.764029 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:00.764041 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:00.765698 (+ 1657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:00.767262 (+ 1564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:00.767270 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:00.767272 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:00.767563 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:00.767724 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:00.767724 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:00.767725 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:00.767858 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:00.768188 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:00.768198 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:00.768398 (+ 200us) client_negotiation.cc:769] Sending connection context
0811 01:01:00.768520 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 01:01:00.768705 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":88,"threads_started":1}
I20260811 01:01:00.769515 24030 heartbeater.cc:347] Connected to a master server at 127.13.30.190:45431
I20260811 01:01:00.769624 24030 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:00.769810 24030 heartbeater.cc:511] Master 127.13.30.190:45431 requested a full tablet report, sending...
I20260811 01:01:00.770411 23692 ts_manager.cc:194] Registered new tserver with Master: 3277febdecd149e0bd31853aefb16946 (127.13.30.129:36911)
I20260811 01:01:00.771307 23692 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:60689
WARNING: no policy specified for oryx/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.130.keytab.
Entry for principal oryx/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.130.keytab.
I20260811 01:01:00.792867 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45431
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.130.keytab
--principal=oryx/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:44177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:00.878458 24039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:00.878708 24039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:00.878743 24039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:00.880127 24039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:00.880205 24039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:00.880249 24039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:01:00.882153 24039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:44177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.130.keytab
--principal=oryx/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:00.882459 24039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:00.882719 24039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:00.888245 24050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:00.888221 24049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:00.888221 24052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:00.888610 24039 server_base.cc:1034] running on GCE node
I20260811 01:01:00.888928 24039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:00.889257 24039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:00.890435 24039 hybrid_clock.cc:648] HybridClock initialized: now 1786410060890403 us; error 41 us; skew 500 ppm
Aug 11 01:01:00 dist-test-slave-42z9 krb5kdc[23619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410060, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:00.893309 24039 init.cc:377] Logged in from keytab as oryx/127.13.30.130@KRBTEST.COM (short username oryx)
I20260811 01:01:00.893858 24039 webserver.cc:460] Webserver started at http://127.13.30.130:40339/ using document root <none> and password file <none>
I20260811 01:01:00.894084 24039 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:00.894138 24039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:00.894279 24039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:00.895417 24039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "0c1862260007427eb9f43a6f7309b47c"
format_stamp: "Formatted at 2026-08-11 01:01:00 on dist-test-slave-42z9"
server_key: "39f28c930a31d6d004520b0a93bc8dca"
server_key_iv: "437500593fb3105f0c46ab219b3f0755"
server_key_version: "encryptionkey@0"
I20260811 01:01:00.895792 24039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "0c1862260007427eb9f43a6f7309b47c"
format_stamp: "Formatted at 2026-08-11 01:01:00 on dist-test-slave-42z9"
server_key: "39f28c930a31d6d004520b0a93bc8dca"
server_key_iv: "437500593fb3105f0c46ab219b3f0755"
server_key_version: "encryptionkey@0"
I20260811 01:01:00.897184 24039 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:01:00.898036 24066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:00.898197 24039 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:00.898284 24039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "0c1862260007427eb9f43a6f7309b47c"
format_stamp: "Formatted at 2026-08-11 01:01:00 on dist-test-slave-42z9"
server_key: "39f28c930a31d6d004520b0a93bc8dca"
server_key_iv: "437500593fb3105f0c46ab219b3f0755"
server_key_version: "encryptionkey@0"
I20260811 01:01:00.898360 24039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:00.921634 24039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:00.923602 24039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:00.923746 24039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:00.923987 24039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:00.924292 24039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:00.924327 24039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:00.924358 24039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:00.924382 24039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:00.930445 24039 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:39751
I20260811 01:01:00.930496 24275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:39751 every 8 connection(s)
I20260811 01:01:00.930876 24039 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
Aug 11 01:01:00 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410060, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:00.939551 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 24039
I20260811 01:01:00.939661 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:01:00.939867 13434 external_mini_cluster.cc:1428] Setting key 13d8a6b9201bfcfa2e782120b996a7e0
I20260811 01:01:00.940012 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:00.931612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:33989 (local address 127.13.30.190:45431)
0811 01:01:00.931674 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:00.931677 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:00.931870 (+ 193us) server_negotiation.cc:407] Connection header received
0811 01:01:00.932419 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:00.932420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:00.932433 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:00.932489 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:00.933553 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:00.934056 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:00.935068 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:00.935258 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:00.935315 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:00.937474 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:00.937476 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:00.937476 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:00.937484 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:00.938744 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:00.939097 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:00.939098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:00.939099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:00.939157 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:00.939364 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:00.939364 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:00.939364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:00.939508 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:00.939577 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:00.939831 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 01:01:00.939926 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 01:01:00.940261 24278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:00.931593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.130:33989)
0811 01:01:00.931751 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:00.931790 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:00.932314 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:00.932578 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:00.932581 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:00.933189 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:00.933405 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:00.933410 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:00.934137 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:00.934138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:00.934986 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:00.934990 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:00.935329 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:00.935330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:00.935438 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:00.935946 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:00.935955 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:00.937369 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:00.938812 (+ 1443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:00.938817 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:00.938819 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:00.939030 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:00.939208 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:00.939208 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:00.939209 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:00.939312 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:00.939565 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:00.939568 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:00.939713 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 01:01:00.939797 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 01:01:00.939941 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":83,"threads_started":1}
I20260811 01:01:00.940711 24276 heartbeater.cc:347] Connected to a master server at 127.13.30.190:45431
I20260811 01:01:00.940836 24276 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:00.941052 24276 heartbeater.cc:511] Master 127.13.30.190:45431 requested a full tablet report, sending...
I20260811 01:01:00.941495 23692 ts_manager.cc:194] Registered new tserver with Master: 0c1862260007427eb9f43a6f7309b47c (127.13.30.130:39751)
I20260811 01:01:00.941861 23692 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:33989
WARNING: no policy specified for oryx/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.131.keytab.
Entry for principal oryx/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.131.keytab.
I20260811 01:01:00.966450 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45431
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.131.keytab
--principal=oryx/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:44177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:01.050940 24282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:01.051163 24282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:01.051188 24282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:01.052380 24282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:01.052423 24282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:01.052451 24282 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:01:01.054033 24282 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:44177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.131.keytab
--principal=oryx/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:01.054278 24282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:01.054517 24282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:01.059756 24294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:01.059756 24289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:01.059794 24282 server_base.cc:1034] running on GCE node
W20260811 01:01:01.059759 24288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:01.060245 24282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:01.060535 24282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:01.061695 24282 hybrid_clock.cc:648] HybridClock initialized: now 1786410061061683 us; error 35 us; skew 500 ppm
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:01.064417 24282 init.cc:377] Logged in from keytab as oryx/127.13.30.131@KRBTEST.COM (short username oryx)
I20260811 01:01:01.064924 24282 webserver.cc:460] Webserver started at http://127.13.30.131:38577/ using document root <none> and password file <none>
I20260811 01:01:01.065140 24282 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:01.065186 24282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:01.065322 24282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:01.066560 24282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "cc1367cabba94f7cbea786674b63dc89"
format_stamp: "Formatted at 2026-08-11 01:01:01 on dist-test-slave-42z9"
server_key: "7e4d7aa92fc9b0046f4641328bc2fff5"
server_key_iv: "a503798f0045c5de352c75892ffb02f4"
server_key_version: "encryptionkey@0"
I20260811 01:01:01.066915 24282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "cc1367cabba94f7cbea786674b63dc89"
format_stamp: "Formatted at 2026-08-11 01:01:01 on dist-test-slave-42z9"
server_key: "7e4d7aa92fc9b0046f4641328bc2fff5"
server_key_iv: "a503798f0045c5de352c75892ffb02f4"
server_key_version: "encryptionkey@0"
I20260811 01:01:01.068430 24282 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:01:01.069268 24316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:01.069474 24282 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:01.069578 24282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "cc1367cabba94f7cbea786674b63dc89"
format_stamp: "Formatted at 2026-08-11 01:01:01 on dist-test-slave-42z9"
server_key: "7e4d7aa92fc9b0046f4641328bc2fff5"
server_key_iv: "a503798f0045c5de352c75892ffb02f4"
server_key_version: "encryptionkey@0"
I20260811 01:01:01.069656 24282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:01.083802 24282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:01.086076 24282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:01.086244 24282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:01.086493 24282 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:01.086792 24282 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:01.086823 24282 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:01.086845 24282 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:01.086858 24282 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:01.092633 24282 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:41971
I20260811 01:01:01.092705 24532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:41971 every 8 connection(s)
I20260811 01:01:01.093051 24282 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:01.102633 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 24282
I20260811 01:01:01.102741 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:01:01.102905 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.093965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:60305 (local address 127.13.30.190:45431)
0811 01:01:01.094025 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.094027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.094267 (+ 240us) server_negotiation.cc:407] Connection header received
0811 01:01:01.094803 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.094805 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.094818 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.094877 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.095891 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.096400 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.097413 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.097646 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.097704 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.100055 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.100057 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.100058 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.100067 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.101502 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.101912 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.101913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.101913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.101972 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.102198 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.102199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.102199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.102323 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.102395 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.102722 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.102812 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 01:01:01.102931 13434 external_mini_cluster.cc:1428] Setting key 5467508305e39a2e456c6b18a1e8d5df
I20260811 01:01:01.103026 24535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.093955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.131:60305)
0811 01:01:01.094139 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.094179 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.094697 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.094954 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.094957 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.095571 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.095785 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.095790 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.096495 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.096496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.097318 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.097321 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.097724 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.097726 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.097862 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.098410 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.098419 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.099949 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.101576 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.101587 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.101590 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.101832 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.102025 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.102026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.102027 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.102141 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.102409 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.102418 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.102572 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.102677 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.102823 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":81,"threads_started":1}
I20260811 01:01:01.103497 24533 heartbeater.cc:347] Connected to a master server at 127.13.30.190:45431
I20260811 01:01:01.103610 24533 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:01.103825 24533 heartbeater.cc:511] Master 127.13.30.190:45431 requested a full tablet report, sending...
I20260811 01:01:01.104228 23691 ts_manager.cc:194] Registered new tserver with Master: cc1367cabba94f7cbea786674b63dc89 (127.13.30.131:41971)
I20260811 01:01:01.104615 23691 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:60305
I20260811 01:01:01.114907 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.13.30.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.30.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.30.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.189.keytab.
Entry for principal oryx/127.13.30.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.189.keytab.
I20260811 01:01:01.142336 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.189:37329
--webserver_interface=127.13.30.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.189.keytab
--principal=oryx/127.13.30.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:44177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:45431,127.13.30.189:37329
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:01.230643 24539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:01.230890 24539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:01.230913 24539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:01.232158 24539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:01:01.232201 24539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:01.232214 24539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:01.232225 24539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:01:01.232236 24539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:01:01.233867 24539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:44177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:45431,127.13.30.189:37329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.189.keytab
--principal=oryx/127.13.30.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.189:37329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.30.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
W20260811 01:01:01.234009 24539 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.13.30.190:45431,127.13.30.189:37329'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 01:01:01.234134 24539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:01.234329 24539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:01.239804 24547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:01.239781 24546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:01.239794 24549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:01.240046 24539 server_base.cc:1034] running on GCE node
I20260811 01:01:01.240372 24539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:01.240898 24539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:01.242097 24539 hybrid_clock.cc:648] HybridClock initialized: now 1786410061242074 us; error 50 us; skew 500 ppm
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:01.244943 24539 init.cc:377] Logged in from keytab as oryx/127.13.30.189@KRBTEST.COM (short username oryx)
I20260811 01:01:01.245487 24539 webserver.cc:460] Webserver started at http://127.13.30.189:42897/ using document root <none> and password file <none>
I20260811 01:01:01.245720 24539 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:01.245770 24539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:01.245905 24539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:01.247004 24539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/data/instance:
uuid: "70fe788d37cf432fa2812890a2d12953"
format_stamp: "Formatted at 2026-08-11 01:01:01 on dist-test-slave-42z9"
server_key: "2050a411fdf3c4a955fd242f2f7604c0"
server_key_iv: "f6e3f7065c2b16499beba07a4c0627fa"
server_key_version: "encryptionkey@0"
I20260811 01:01:01.247346 24539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/wal/instance:
uuid: "70fe788d37cf432fa2812890a2d12953"
format_stamp: "Formatted at 2026-08-11 01:01:01 on dist-test-slave-42z9"
server_key: "2050a411fdf3c4a955fd242f2f7604c0"
server_key_iv: "f6e3f7065c2b16499beba07a4c0627fa"
server_key_version: "encryptionkey@0"
I20260811 01:01:01.248812 24539 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:01:01.249559 24559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:01.249718 24539 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:01.249804 24539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/wal
uuid: "70fe788d37cf432fa2812890a2d12953"
format_stamp: "Formatted at 2026-08-11 01:01:01 on dist-test-slave-42z9"
server_key: "2050a411fdf3c4a955fd242f2f7604c0"
server_key_iv: "f6e3f7065c2b16499beba07a4c0627fa"
server_key_version: "encryptionkey@0"
I20260811 01:01:01.249881 24539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:01.261615 24539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:01.263548 24539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:01.263700 24539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:01.267939 24539 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.189:37329
I20260811 01:01:01.267983 24658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.189:37329 every 8 connection(s)
I20260811 01:01:01.268333 24539 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/data/info.pb
I20260811 01:01:01.269611 24659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:01.271396 24659 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.189@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:01.278478 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 24539
I20260811 01:01:01.280783 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.272163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33710 (local address 127.13.30.190:45431)
0811 01:01:01.272225 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.272227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.272481 (+ 254us) server_negotiation.cc:407] Connection header received
0811 01:01:01.273004 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.273005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.273017 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.273060 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.273787 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.274301 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.275304 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.275488 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.275533 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.277780 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.277783 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.277783 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.277790 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.279145 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.279647 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.279649 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.279649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.279712 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.279992 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.279993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.279993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.280217 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.280284 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.280601 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.280685 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 01:01:01.280973 24662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.272128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:33710)
0811 01:01:01.272326 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.272372 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.272894 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.273129 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.273132 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.273431 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.273695 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.273701 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.274376 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.274376 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.275232 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.275235 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.275546 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.275547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.275650 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.276211 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.276220 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.277671 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.279246 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.279253 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.279256 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.279574 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.279787 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.279788 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.279788 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.279914 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.280287 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.280295 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.280459 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.280566 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.280737 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":120,"threads_started":1}
I20260811 01:01:01.281723 24659 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.30.189@KRBTEST.COM
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.189@KRBTEST.COM for oryx/127.13.30.189@KRBTEST.COM
I20260811 01:01:01.287540 24664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.279094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37866 (local address 127.13.30.189:37329)
0811 01:01:01.279259 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.279264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.279315 (+ 51us) server_negotiation.cc:407] Connection header received
0811 01:01:01.279342 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.279344 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.279356 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.279413 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.280205 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.280999 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.281826 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.282255 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.282321 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.284733 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.284744 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.284744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.284751 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.286412 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.286728 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.286732 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.286733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.286794 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.286962 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.286963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.286963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.287119 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.287273 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.287342 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.287429 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260811 01:01:01.288628 24662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.281975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37329 (local address 127.0.0.1:37872)
0811 01:01:01.282027 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.282036 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.282067 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.282255 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.282255 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.282390 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.282440 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.282441 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.283052 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.283053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.283533 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.283534 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.283956 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.283957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.284026 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.284411 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.284416 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.285749 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.287740 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.287741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.287742 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.287927 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.288102 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.288102 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.288103 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.288166 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.288397 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.288397 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.288432 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.288487 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.288567 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 01:01:01.288754 24666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.282030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37872 (local address 127.13.30.189:37329)
0811 01:01:01.282169 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.282171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.282174 (+ 3us) server_negotiation.cc:407] Connection header received
0811 01:01:01.282186 (+ 12us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.282186 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.282193 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.282240 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.282502 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.282988 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.283598 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.283862 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.283931 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.285830 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.285831 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.285831 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.285837 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.287675 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.287993 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.287994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.287995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.288045 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.288214 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.288214 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.288215 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.288344 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.288397 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.288514 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.288613 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":125,"thread_start_us":100,"threads_started":1}
I20260811 01:01:01.290197 24659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: Bootstrap starting.
I20260811 01:01:01.290930 24659 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:01.291179 24659 log.cc:824] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:01.292063 24659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: No bootstrap required, opened a new log
I20260811 01:01:01.293531 24659 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } }
I20260811 01:01:01.293664 24659 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:01.293699 24659 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70fe788d37cf432fa2812890a2d12953, State: Initialized, Role: FOLLOWER
I20260811 01:01:01.293802 24659 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } }
I20260811 01:01:01.294157 24659 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:01:01.294118 24671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } } }
I20260811 01:01:01.294221 24671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 01:01:01.296530 24687 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:01:01.296586 24687 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:01:01.298460 24539 master_runner.cc:428] Detected that this master 70fe788d37cf432fa2812890a2d12953 is joining an existing cluster
I20260811 01:01:01.298512 24539 master_runner.cc:432] Initiating AddMaster RPC to add 127.13.30.189:37329
I20260811 01:01:01.305608 24666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.299474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37880 (local address 127.13.30.189:37329)
0811 01:01:01.299524 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.299526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.299653 (+ 127us) server_negotiation.cc:407] Connection header received
0811 01:01:01.299737 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.299738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.299747 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.299791 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.300148 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.300634 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.301407 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.301674 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.301730 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.302770 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.302772 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.302772 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.302778 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.304437 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.304753 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.304755 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.304755 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.304812 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.304969 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.304970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.304970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.305091 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.305148 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.305270 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.305537 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":105,"server-negotiator.queue_time_us":28}
I20260811 01:01:01.305979 24697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.299442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37329 (local address 127.0.0.1:37880)
0811 01:01:01.299586 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.299596 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.299676 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.299793 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.299793 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.300009 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.300085 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.300087 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.300702 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.300703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.301333 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.301335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.301735 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.301736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.301793 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.302251 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.302257 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.302702 (+ 445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.304522 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.304523 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.304524 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.304687 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.304867 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.304868 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.304868 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.304920 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.305147 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.305148 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.305187 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.305244 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.305387 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":87,"threads_started":1}
I20260811 01:01:01.306666 24700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.299454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:33722)
0811 01:01:01.299765 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.299774 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.299856 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.300006 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.300007 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.300215 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.300293 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.300295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.301281 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.301282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.302180 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.302183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.302624 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.302625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.302693 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.303116 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.303121 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.303549 (+ 428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.305292 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.305292 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.305293 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.305607 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.305861 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.305861 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.305862 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.305922 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.306315 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.306316 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.306360 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.306437 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.306554 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"spinlock_wait_cycles":11008,"thread_start_us":251,"threads_started":1}
I20260811 01:01:01.306699 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.299575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33722 (local address 127.13.30.190:45431)
0811 01:01:01.299626 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.299628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.299830 (+ 202us) server_negotiation.cc:407] Connection header received
0811 01:01:01.299924 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.299925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.299936 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.299990 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.300395 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.301164 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.302262 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.302539 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.302613 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.303674 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.303675 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.303676 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.303684 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.305197 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.305722 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.305723 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.305724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.305788 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.305991 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.305992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.305992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.306199 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.306257 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.306539 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.306626 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410060, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.190@KRBTEST.COM for oryx/127.13.30.189@KRBTEST.COM
I20260811 01:01:01.316567 24701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.309018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37329 (local address 127.0.0.1:37890)
0811 01:01:01.309202 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.309246 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.309329 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.309517 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.309521 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.309863 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.309939 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.309941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.310595 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.310596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.311557 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.311560 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.311861 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.311863 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.311963 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.312387 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.312392 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.313932 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.315382 (+ 1450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.315392 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.315394 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.315607 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.315785 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.315785 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.315786 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.315858 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.316210 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.316218 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.316274 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.316362 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.316476 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":94,"threads_started":1}
I20260811 01:01:01.316593 24666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.309086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37890 (local address 127.13.30.189:37329)
0811 01:01:01.309130 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.309132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.309333 (+ 201us) server_negotiation.cc:407] Connection header received
0811 01:01:01.309403 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.309404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.309412 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.309506 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.310007 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.310525 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.311629 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.311803 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.311849 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.314018 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.314020 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.314020 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.314028 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.315290 (+ 1262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.315675 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.315676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.315677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.315731 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.315943 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.315945 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.315945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.316108 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.316190 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.316399 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.316492 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 01:01:01.317345 23691 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.13.30.189:37329: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "70fe788d37cf432fa2812890a2d12953"
member_type: NON_VOTER
last_known_addr {
host: "127.13.30.189"
port: 37329
}
attrs {
promote: true
}
}
dest_uuid: "515d747c628940349bea50bbfcd1e591"
cas_config_opid_index: -1
I20260811 01:01:01.317719 23691 consensus_queue.cc:237] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: NON_VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: true } }
I20260811 01:01:01.318234 24702 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 70fe788d37cf432fa2812890a2d12953 (127.13.30.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: NON_VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: true } } }
I20260811 01:01:01.318562 24612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:01.319430 24702 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.13.30.189:37329
I20260811 01:01:01.319530 24612 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 FOLLOWER]: Refusing update from remote peer 515d747c628940349bea50bbfcd1e591: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 01:01:01.319599 24702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: NON_VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: true } } }
I20260811 01:01:01.319660 24702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:01.319890 24702 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: NON_VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:01.319936 24539 master.cc:537] Master@127.13.30.189:37329 shutting down...
W20260811 01:01:01.320776 23670 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 01:01:01.321506 23670 consensus_peers.cc:487] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 -> Peer 70fe788d37cf432fa2812890a2d12953 (127.13.30.189:37329): Couldn't send request to peer 70fe788d37cf432fa2812890a2d12953. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 01:01:01.323076 24539 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:01.323179 24539 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:01.323230 24539 tablet_replica.cc:330] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: stopping tablet replica
I20260811 01:01:01.336978 24539 master.cc:552] Master@127.13.30.189:37329 shutdown complete.
I20260811 01:01:01.337051 24539 master_runner.cc:305] Clearing existing system tablet
I20260811 01:01:01.337190 24539 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:01.337241 24539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:01.338038 24539 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 01:01:01.338577 24713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:01.338708 24539 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:01.338766 24539 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:01.338791 24539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/wal
uuid: "70fe788d37cf432fa2812890a2d12953"
format_stamp: "Formatted at 2026-08-11 01:01:01 on dist-test-slave-42z9"
server_key: "2050a411fdf3c4a955fd242f2f7604c0"
server_key_iv: "f6e3f7065c2b16499beba07a4c0627fa"
server_key_version: "encryptionkey@0"
I20260811 01:01:01.339634 24539 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:01.341049 24539 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 01:01:01.341132 24539 log.cc:1196] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 01:01:01.341354 24539 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: Deleting consensus metadata
I20260811 01:01:01.341496 24539 master_runner.cc:315] Copying system tablet from 127.13.30.190:45431
I20260811 01:01:01.342092 24539 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: tablet copy: Beginning tablet copy session from remote peer at address 127.13.30.190:45431
I20260811 01:01:01.348994 24728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.342421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:33732)
0811 01:01:01.342553 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.342564 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.342638 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.342927 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.342929 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.343337 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.343432 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.343436 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.344489 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.344490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.345072 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.345074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.345569 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.345570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.345626 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.346099 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.346104 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.346450 (+ 346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.348078 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.348079 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.348080 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.348253 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.348443 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.348444 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.348444 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.348491 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.348730 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.348730 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.348771 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.348816 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.348903 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":88,"threads_started":1}
I20260811 01:01:01.349042 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.342520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33732 (local address 127.13.30.190:45431)
0811 01:01:01.342582 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.342584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.342624 (+ 40us) server_negotiation.cc:407] Connection header received
0811 01:01:01.342716 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.342717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.342728 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.342784 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.343541 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.344368 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.345153 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.345486 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.345557 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.346533 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.346535 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.346536 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.346542 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.347993 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.348316 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.348317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.348317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.348380 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.348539 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.348539 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.348539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.348677 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.348744 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.348863 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.348954 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 01:01:01.349663 23723 tablet_copy_service.cc:140] P 515d747c628940349bea50bbfcd1e591: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 70fe788d37cf432fa2812890a2d12953 ({username='oryx', principal='oryx/127.13.30.189@KRBTEST.COM'} at 127.0.0.1:33732)
I20260811 01:01:01.349798 23723 tablet_copy_service.cc:161] P 515d747c628940349bea50bbfcd1e591: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 70fe788d37cf432fa2812890a2d12953 at {username='oryx', principal='oryx/127.13.30.189@KRBTEST.COM'} at 127.0.0.1:33732: session id = 70fe788d37cf432fa2812890a2d12953-00000000000000000000000000000000
I20260811 01:01:01.350564 23723 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 01:01:01.351212 24539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 01:01:01.352270 24539 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: tablet copy: Starting download of 0 data blocks...
I20260811 01:01:01.352406 24539 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: tablet copy: Starting download of 1 WAL segments...
I20260811 01:01:01.353482 24539 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 01:01:01.354342 23723 tablet_copy_service.cc:342] P 515d747c628940349bea50bbfcd1e591: Request end of tablet copy session 70fe788d37cf432fa2812890a2d12953-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.13.30.189@KRBTEST.COM'} at 127.0.0.1:33732
I20260811 01:01:01.354396 23723 tablet_copy_service.cc:433] P 515d747c628940349bea50bbfcd1e591: ending tablet copy session 70fe788d37cf432fa2812890a2d12953-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 70fe788d37cf432fa2812890a2d12953
I20260811 01:01:01.357115 24539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:01.358296 24730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:01.358331 24733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:01.358388 24539 server_base.cc:1034] running on GCE node
W20260811 01:01:01.361588 24735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:01.361797 24539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:01.361979 24539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:01.363103 24539 hybrid_clock.cc:648] HybridClock initialized: now 1786410061363098 us; error 29 us; skew 500 ppm
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:01.364385 24539 init.cc:377] Logged in from keytab as oryx/127.13.30.189@KRBTEST.COM (short username oryx)
I20260811 01:01:01.364665 24539 webserver.cc:460] Webserver started at http://127.13.30.189:36955/ using document root <none> and password file <none>
I20260811 01:01:01.364786 24539 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:01.364820 24539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:01.365432 24539 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:01.366009 24763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:01.366165 24539 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:01.366214 24539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/wal
uuid: "70fe788d37cf432fa2812890a2d12953"
format_stamp: "Formatted at 2026-08-11 01:01:01 on dist-test-slave-42z9"
server_key: "2050a411fdf3c4a955fd242f2f7604c0"
server_key_iv: "f6e3f7065c2b16499beba07a4c0627fa"
server_key_version: "encryptionkey@0"
I20260811 01:01:01.366274 24539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:01.370139 24539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:01.371703 24539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:01.374467 24539 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.189:37329
I20260811 01:01:01.374833 24854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.189:37329 every 8 connection(s)
I20260811 01:01:01.374943 24539 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-1/data/info.pb
I20260811 01:01:01.375819 24855 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:01:01.376267 24855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: Bootstrap starting.
I20260811 01:01:01.378602 24855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:01:01.378813 24855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: Bootstrap complete.
I20260811 01:01:01.379040 24855 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: NON_VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: true } }
I20260811 01:01:01.379117 24855 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 70fe788d37cf432fa2812890a2d12953, State: Initialized, Role: LEARNER
I20260811 01:01:01.379153 24855 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: NON_VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: true } }
I20260811 01:01:01.379365 24855 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:01:01.379390 24865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: NON_VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: true } } }
I20260811 01:01:01.379511 24865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: This master's current role is: LEARNER
I20260811 01:01:01.380903 24881 catalog_manager.cc:1259] Loaded cluster ID: aaf8e0969b664caf9eb6b9ac9ddd232b
I20260811 01:01:01.381006 24881 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: loading cluster ID for follower catalog manager: success
I20260811 01:01:01.382071 24881 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: acquiring CA information for follower catalog manager: success
I20260811 01:01:01.382360 24881 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:01:01.396637 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.389401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37908 (local address 127.13.30.189:37329)
0811 01:01:01.389604 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.389606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.389619 (+ 13us) server_negotiation.cc:407] Connection header received
0811 01:01:01.389649 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.389649 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.389662 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.389747 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.390290 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.391331 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.392044 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.392371 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.392455 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.393665 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.393667 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.393667 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.393676 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.395468 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.395822 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.395823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.395824 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.395894 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.396071 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.396071 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.396072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.396222 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.396332 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.396409 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.396508 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":121,"threads_started":1}
WARNING: no policy specified for oryx/127.13.30.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.30.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.30.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.188.keytab.
Entry for principal oryx/127.13.30.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.188.keytab.
I20260811 01:01:01.432781 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.188:33705
--webserver_interface=127.13.30.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.188.keytab
--principal=oryx/127.13.30.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:44177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:45431,127.13.30.189:37329,127.13.30.188:33705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:01.522504 24886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:01.522744 24886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:01.522769 24886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:01.523996 24886 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:01:01.524036 24886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:01.524049 24886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:01.524061 24886 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:01:01.524071 24886 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:01:01.525732 24886 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:44177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:45431,127.13.30.189:37329,127.13.30.188:33705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.188.keytab
--principal=oryx/127.13.30.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.188:33705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.30.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:01.525975 24886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:01.526180 24886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:01.531203 24893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:01.531211 24898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:01.531205 24894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:01.531420 24886 server_base.cc:1034] running on GCE node
I20260811 01:01:01.531816 24886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:01.532132 24886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:01.533310 24886 hybrid_clock.cc:648] HybridClock initialized: now 1786410061533292 us; error 37 us; skew 500 ppm
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:01.536067 24886 init.cc:377] Logged in from keytab as oryx/127.13.30.188@KRBTEST.COM (short username oryx)
I20260811 01:01:01.536556 24886 webserver.cc:460] Webserver started at http://127.13.30.188:42069/ using document root <none> and password file <none>
I20260811 01:01:01.536774 24886 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:01.536819 24886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:01.536923 24886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:01.538049 24886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/data/instance:
uuid: "f52531ad45d445749d6161a0a5950355"
format_stamp: "Formatted at 2026-08-11 01:01:01 on dist-test-slave-42z9"
server_key: "8e671c8470cdd7fbc12e80d058839b9d"
server_key_iv: "426cf3865d3e12636988b2fd08130044"
server_key_version: "encryptionkey@0"
I20260811 01:01:01.538353 24886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/wal/instance:
uuid: "f52531ad45d445749d6161a0a5950355"
format_stamp: "Formatted at 2026-08-11 01:01:01 on dist-test-slave-42z9"
server_key: "8e671c8470cdd7fbc12e80d058839b9d"
server_key_iv: "426cf3865d3e12636988b2fd08130044"
server_key_version: "encryptionkey@0"
I20260811 01:01:01.539915 24886 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:01:01.540628 24908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:01.540786 24886 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:01.540869 24886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/wal
uuid: "f52531ad45d445749d6161a0a5950355"
format_stamp: "Formatted at 2026-08-11 01:01:01 on dist-test-slave-42z9"
server_key: "8e671c8470cdd7fbc12e80d058839b9d"
server_key_iv: "426cf3865d3e12636988b2fd08130044"
server_key_version: "encryptionkey@0"
I20260811 01:01:01.540934 24886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:01.553560 24886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:01.555518 24886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:01.555639 24886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:01.560690 24886 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.188:33705
I20260811 01:01:01.560748 25001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.188:33705 every 8 connection(s)
I20260811 01:01:01.561154 24886 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/data/info.pb
I20260811 01:01:01.562522 25002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:01.564270 25002 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.188@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:01.571008 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 24886
I20260811 01:01:01.574301 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.565237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33748 (local address 127.13.30.190:45431)
0811 01:01:01.565338 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.565341 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.565529 (+ 188us) server_negotiation.cc:407] Connection header received
0811 01:01:01.566081 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.566082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.566093 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.566172 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.566910 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.567457 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.568411 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.568597 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.568647 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.571276 (+ 2629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.571278 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.571278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.571287 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.572915 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.573355 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.573357 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.573357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.573413 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.573670 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.573671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.573671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.573797 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.573856 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.574125 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.574211 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 01:01:01.574525 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.565064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:33748)
0811 01:01:01.565382 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.565420 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.565956 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.566245 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.566249 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.566604 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.566813 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.566818 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.567534 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.567534 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.568339 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.568341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.568672 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.568673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.568777 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.569423 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.569434 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.571134 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.572996 (+ 1862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.573004 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.573006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.573288 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.573505 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.573506 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.573506 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.573615 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.573855 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.573862 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.574005 (+ 143us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.574096 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.574270 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":210,"threads_started":1}
I20260811 01:01:01.575222 25002 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.30.188@KRBTEST.COM
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.188@KRBTEST.COM for oryx/127.13.30.189@KRBTEST.COM
I20260811 01:01:01.579921 25006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.571703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44136 (local address 127.13.30.188:33705)
0811 01:01:01.571897 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.571902 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.571921 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:01:01.571940 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.571942 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.571953 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.572027 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.572640 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.573404 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.574102 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.574434 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.574502 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.576949 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.576958 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.576959 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.576966 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.578565 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.578912 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.578915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.578916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.578979 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.579173 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.579174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.579174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.579388 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.579513 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.579662 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.579832 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":110,"threads_started":1}
I20260811 01:01:01.581770 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.575490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37329 (local address 127.0.0.1:37912)
0811 01:01:01.575540 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.575549 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.575583 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.575693 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.575694 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.575840 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.575900 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.575902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.576614 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.576615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.577131 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.577133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.577574 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.577574 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.577637 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.578040 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.578044 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.579151 (+ 1107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.580837 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.580838 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.580839 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.581007 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.581209 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.581209 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.581209 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.581257 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.581490 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.581491 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.581529 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.581578 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.581692 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 01:01:01.581772 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.575549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37912 (local address 127.13.30.189:37329)
0811 01:01:01.575588 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.575590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.575601 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:01:01.575630 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.575630 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.575641 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.575686 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.575964 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.576435 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.577216 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.577496 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.577564 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.579230 (+ 1666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.579232 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.579232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.579241 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.580751 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.581089 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.581090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.581090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.581149 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.581301 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.581301 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.581302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.581400 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.581499 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.581599 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.581696 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 01:01:01.582149 25002 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.188@KRBTEST.COM for oryx/127.13.30.188@KRBTEST.COM
I20260811 01:01:01.587898 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.582386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:33705 (local address 127.0.0.1:44140)
0811 01:01:01.582470 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.582480 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.582519 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.582604 (+ 85us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.582604 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.582709 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.582742 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.582743 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.583298 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.583298 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.583778 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.583779 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.584095 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.584096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.584133 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.584508 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.584513 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.585651 (+ 1138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.586986 (+ 1335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.586987 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.586987 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.587143 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.587361 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.587362 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.587362 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.587447 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.587637 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.587637 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.587673 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.587720 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.587807 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 01:01:01.587952 25006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.582432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44140 (local address 127.13.30.188:33705)
0811 01:01:01.582484 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.582486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.582508 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:01:01.582552 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.582553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.582561 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.582601 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.582779 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.583243 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.583848 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.584047 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.584092 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.585740 (+ 1648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.585742 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.585742 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.585748 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.586896 (+ 1148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.587193 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.587194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.587194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.587237 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.587502 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.587503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.587503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.587594 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.587636 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.587739 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.587848 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":33}
I20260811 01:01:01.589488 25002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: Bootstrap starting.
I20260811 01:01:01.590462 25002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:01.590852 25002 log.cc:824] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:01.591677 25002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: No bootstrap required, opened a new log
I20260811 01:01:01.593492 25002 raft_consensus.cc:348] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } }
I20260811 01:01:01.593639 25002 raft_consensus.cc:374] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:01.593674 25002 raft_consensus.cc:729] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f52531ad45d445749d6161a0a5950355, State: Initialized, Role: FOLLOWER
I20260811 01:01:01.593811 25002 consensus_queue.cc:260] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } }
I20260811 01:01:01.594264 25002 sys_catalog.cc:564] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:01:01.594254 25009 sys_catalog.cc:455] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } } }
I20260811 01:01:01.594378 25009 sys_catalog.cc:458] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 01:01:01.596608 25024 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:01:01.596665 25024 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:01:01.598958 24886 master_runner.cc:428] Detected that this master f52531ad45d445749d6161a0a5950355 is joining an existing cluster
I20260811 01:01:01.599020 24886 master_runner.cc:432] Initiating AddMaster RPC to add 127.13.30.188:33705
I20260811 01:01:01.607647 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.600375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37922 (local address 127.13.30.189:37329)
0811 01:01:01.600504 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.600507 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.600816 (+ 309us) server_negotiation.cc:407] Connection header received
0811 01:01:01.600867 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.600868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.600881 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.600929 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.601555 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.602350 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.603609 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.603905 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.603955 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.605166 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.605167 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.605167 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.605175 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.606554 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.606882 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.606883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.606883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.606945 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.607111 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.607112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.607112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.607231 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.607289 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.607452 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.607539 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 01:01:01.607661 25033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.600305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37329 (local address 127.0.0.1:37922)
0811 01:01:01.600745 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.600754 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.600812 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.600996 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.600997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.601292 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.601430 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.601433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.602459 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.602460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.603477 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.603480 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.604029 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.604030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.604090 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.604576 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.604581 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.605068 (+ 487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.606635 (+ 1567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.606636 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.606636 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.606815 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.606999 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.606999 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.607000 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.607062 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.607287 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.607288 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.607354 (+ 66us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.607414 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.607542 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"mutex_wait_us":26,"thread_start_us":106,"threads_started":1}
I20260811 01:01:01.629794 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.600430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33752 (local address 127.13.30.190:45431)
0811 01:01:01.600556 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.600558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.600820 (+ 262us) server_negotiation.cc:407] Connection header received
0811 01:01:01.600938 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.600940 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.600952 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.600984 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.601572 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.602338 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.603756 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.604073 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.604118 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.626833 (+ 22715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.626835 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.626836 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.626845 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.628574 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.628893 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.628894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.628894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.628962 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.629184 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.629185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.629186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.629312 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.629367 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.629600 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.629691 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260811 01:01:01.629848 25006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.600623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44154 (local address 127.13.30.188:33705)
0811 01:01:01.600669 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.600671 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.600978 (+ 307us) server_negotiation.cc:407] Connection header received
0811 01:01:01.601047 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.601047 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.601055 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.601079 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.601579 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.602349 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.603571 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.603842 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.603880 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.626773 (+ 22893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.626775 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.626775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.626784 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.628225 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.628544 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.628545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.628545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.628598 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.628990 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.628991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.628991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.629116 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.629180 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.629599 (+ 419us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.629763 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":76,"server-negotiator.queue_time_us":24}
I20260811 01:01:01.629848 25035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.600286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:33752)
0811 01:01:01.600745 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.600757 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.600848 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.601066 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.601066 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.601343 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.601428 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.601431 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.602446 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.602447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.603646 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.603649 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.604202 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.604203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.604269 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.626160 (+ 21891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.626167 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.626724 (+ 557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.628657 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.628657 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.628658 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.628825 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.629044 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.629045 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.629045 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.629110 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.629377 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.629378 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.629474 (+ 96us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.629553 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.629699 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"mutex_wait_us":2,"thread_start_us":102,"threads_started":1}
I20260811 01:01:01.630096 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.600597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:33705 (local address 127.0.0.1:44154)
0811 01:01:01.600928 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.600938 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.600995 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.601130 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.601130 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.601379 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.601464 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.601465 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.602477 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.602478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.603476 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.603480 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.604024 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.604025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.604185 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.626112 (+ 21927us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.626121 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.626655 (+ 534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.628313 (+ 1658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.628314 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.628315 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.628480 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.628888 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.628888 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.628889 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.628933 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.629394 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.629395 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.629495 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.629633 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.629989 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":351,"thread_start_us":86,"threads_started":1}
I20260811 01:01:01.631371 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 23802
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410060, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.190@KRBTEST.COM for oryx/127.13.30.188@KRBTEST.COM
I20260811 01:01:01.694154 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:36911
--local_ip_for_outbound_sockets=127.13.30.129
--tserver_master_addrs=127.13.30.190:45431
--webserver_port=42987
--webserver_interface=127.13.30.129
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.129.keytab
--principal=oryx/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:44177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.13.30.190:45431,127.13.30.189:37329
--tserver_master_addrs=127.13.30.190:45431,127.13.30.189:37329,127.13.30.188:33705 with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:01:01.697293 24701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.688161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:33705 (local address 127.0.0.1:44168)
0811 01:01:01.688732 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.688746 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.688804 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.689344 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.689346 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.689590 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.689649 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.689652 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.690580 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.690581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.691384 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.691389 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.691856 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.691857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.691936 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.692474 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.692480 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.694036 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.696101 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.696103 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.696104 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.696340 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.696565 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.696566 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.696567 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.696632 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.696948 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.696949 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.697003 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.697077 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.697189 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541}
I20260811 01:01:01.697309 25006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.688944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44168 (local address 127.13.30.188:33705)
0811 01:01:01.689174 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.689176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.689187 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:01:01.689228 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.689229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.689241 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.689313 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.689749 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.690477 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.691492 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.691763 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.691862 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.694157 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.694159 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.694160 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.694168 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.695996 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.696429 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.696431 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.696431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.696495 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.696700 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.696701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.696701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.696861 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.696936 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.697123 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.697215 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201}
I20260811 01:01:01.698345 23691 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.13.30.188:33705: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "f52531ad45d445749d6161a0a5950355"
member_type: NON_VOTER
last_known_addr {
host: "127.13.30.188"
port: 33705
}
attrs {
promote: true
}
}
dest_uuid: "515d747c628940349bea50bbfcd1e591"
cas_config_opid_index: 5
I20260811 01:01:01.698653 23691 consensus_queue.cc:237] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: NON_VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: true } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } }
I20260811 01:01:01.699054 24706 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER f52531ad45d445749d6161a0a5950355 (127.13.30.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: NON_VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: true } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } } }
I20260811 01:01:01.700170 24706 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.13.30.188:33705
I20260811 01:01:01.700258 24706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: NON_VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: true } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } } }
I20260811 01:01:01.700326 24706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:01.701231 24953 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:01.701630 24886 master.cc:537] Master@127.13.30.188:33705 shutting down...
I20260811 01:01:01.702484 24953 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 1 FOLLOWER]: Refusing update from remote peer 515d747c628940349bea50bbfcd1e591: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 01:01:01.703455 24702 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 01:01:01.704262 23674 consensus_peers.cc:487] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 -> Peer f52531ad45d445749d6161a0a5950355 (127.13.30.188:33705): Couldn't send request to peer f52531ad45d445749d6161a0a5950355. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 01:01:01.706008 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.700640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37938 (local address 127.13.30.189:37329)
0811 01:01:01.700690 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.700692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.702112 (+ 1420us) server_negotiation.cc:407] Connection header received
0811 01:01:01.702239 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.702240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.702269 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.702313 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:01.702546 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.703309 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.704780 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.705408 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.705522 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.705603 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.705877 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.705933 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 01:01:01.706243 24701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.700539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37329 (local address 127.0.0.1:37938)
0811 01:01:01.702032 (+ 1493us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.702045 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.702145 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.702410 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.702411 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.702413 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:01.702468 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.702469 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.703428 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.703429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.704661 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.704665 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.705667 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.705669 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.705742 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.705772 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.706109 (+ 337us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.706174 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1466}
I20260811 01:01:01.707042 24808 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 LEARNER]: Refusing update from remote peer 515d747c628940349bea50bbfcd1e591: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 01:01:01.707324 24702 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: NON_VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 01:01:01.708076 24808 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER f52531ad45d445749d6161a0a5950355 (127.13.30.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: NON_VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: true } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } } }
I20260811 01:01:01.709805 24702 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591: attempting to promote NON_VOTER 70fe788d37cf432fa2812890a2d12953 to VOTER
I20260811 01:01:01.709810 25040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: NON_VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: true } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } } }
I20260811 01:01:01.709918 25040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: This master's current role is: LEARNER
I20260811 01:01:01.710079 24702 consensus_queue.cc:237] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } }
I20260811 01:01:01.710471 24886 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:01.710577 24886 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:01.710619 24886 tablet_replica.cc:330] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: stopping tablet replica
I20260811 01:01:01.711205 24808 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 LEARNER]: Refusing update from remote peer 515d747c628940349bea50bbfcd1e591: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 01:01:01.711582 24706 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260811 01:01:01.711871 23674 consensus_peers.cc:487] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 -> Peer f52531ad45d445749d6161a0a5950355 (127.13.30.188:33705): Couldn't send request to peer f52531ad45d445749d6161a0a5950355. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 01:01:01.712648 24865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 515d747c628940349bea50bbfcd1e591. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: NON_VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: true } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } } }
I20260811 01:01:01.712770 24865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: This master's current role is: LEARNER
I20260811 01:01:01.713356 24706 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 70fe788d37cf432fa2812890a2d12953 (127.13.30.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } } }
I20260811 01:01:01.714545 24706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } } }
I20260811 01:01:01.714636 24706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:01.714685 24706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } } }
I20260811 01:01:01.714726 24706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:01.714994 24808 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 70fe788d37cf432fa2812890a2d12953 (127.13.30.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } } }
I20260811 01:01:01.716167 24865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } } }
I20260811 01:01:01.716260 24865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:01:01.724687 24886 master.cc:552] Master@127.13.30.188:33705 shutdown complete.
I20260811 01:01:01.724764 24886 master_runner.cc:305] Clearing existing system tablet
I20260811 01:01:01.724897 24886 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:01.724957 24886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:01.725934 24886 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 01:01:01.726557 25046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:01.726714 24886 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:01.726778 24886 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 01:01:01.726801 24886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/wal
uuid: "f52531ad45d445749d6161a0a5950355"
format_stamp: "Formatted at 2026-08-11 01:01:01 on dist-test-slave-42z9"
server_key: "8e671c8470cdd7fbc12e80d058839b9d"
server_key_iv: "426cf3865d3e12636988b2fd08130044"
server_key_version: "encryptionkey@0"
I20260811 01:01:01.727830 24886 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:01.729341 24886 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 01:01:01.729426 24886 log.cc:1196] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 01:01:01.729702 24886 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: Deleting consensus metadata
I20260811 01:01:01.729820 24886 master_runner.cc:315] Copying system tablet from 127.13.30.190:45431
I20260811 01:01:01.730497 24886 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: tablet copy: Beginning tablet copy session from remote peer at address 127.13.30.190:45431
I20260811 01:01:01.744787 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.730916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33762 (local address 127.13.30.190:45431)
0811 01:01:01.730977 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.730979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.737733 (+ 6754us) server_negotiation.cc:407] Connection header received
0811 01:01:01.737785 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.737786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.737803 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.737906 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.738347 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.739108 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.740225 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.740519 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.740601 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.741881 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.741883 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.741883 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.741892 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.743570 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.744000 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.744001 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.744002 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.744068 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.744254 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.744255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.744255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.744390 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.744449 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.744601 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.744683 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 01:01:01.744804 25054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.730880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:33762)
0811 01:01:01.737594 (+ 6714us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.737615 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.737727 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.737931 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.737932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.738172 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.738251 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.738253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.739214 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.739215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.740119 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.740123 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.740610 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.740611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.740687 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.741232 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.741238 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.741769 (+ 531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.743667 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.743668 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.743669 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.743910 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.744126 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.744126 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.744127 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.744199 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.744446 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.744447 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.744505 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.744573 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.744698 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6678,"thread_start_us":89,"threads_started":1}
I20260811 01:01:01.745564 23723 tablet_copy_service.cc:140] P 515d747c628940349bea50bbfcd1e591: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer f52531ad45d445749d6161a0a5950355 ({username='oryx', principal='oryx/127.13.30.188@KRBTEST.COM'} at 127.0.0.1:33762)
I20260811 01:01:01.745635 23723 tablet_copy_service.cc:161] P 515d747c628940349bea50bbfcd1e591: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer f52531ad45d445749d6161a0a5950355 at {username='oryx', principal='oryx/127.13.30.188@KRBTEST.COM'} at 127.0.0.1:33762: session id = f52531ad45d445749d6161a0a5950355-00000000000000000000000000000000
I20260811 01:01:01.746354 23723 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 01:01:01.746961 24886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 01:01:01.748483 24886 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: tablet copy: Starting download of 0 data blocks...
I20260811 01:01:01.748664 24886 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: tablet copy: Starting download of 1 WAL segments...
I20260811 01:01:01.749536 24886 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 01:01:01.750659 23723 tablet_copy_service.cc:342] P 515d747c628940349bea50bbfcd1e591: Request end of tablet copy session f52531ad45d445749d6161a0a5950355-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.13.30.188@KRBTEST.COM'} at 127.0.0.1:33762
I20260811 01:01:01.750732 23723 tablet_copy_service.cc:433] P 515d747c628940349bea50bbfcd1e591: ending tablet copy session f52531ad45d445749d6161a0a5950355-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer f52531ad45d445749d6161a0a5950355
I20260811 01:01:01.753953 24886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:01.755223 25055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:01.755244 25060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:01.755595 24886 server_base.cc:1034] running on GCE node
W20260811 01:01:01.757575 25058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:01.757738 24886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:01.757901 24886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:01.759038 24886 hybrid_clock.cc:648] HybridClock initialized: now 1786410061759033 us; error 28 us; skew 500 ppm
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:01.760632 24886 init.cc:377] Logged in from keytab as oryx/127.13.30.188@KRBTEST.COM (short username oryx)
I20260811 01:01:01.761003 24886 webserver.cc:460] Webserver started at http://127.13.30.188:35705/ using document root <none> and password file <none>
I20260811 01:01:01.761116 24886 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:01.761147 24886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:01.761893 24886 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:01.762482 25074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:01.762643 24886 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:01.762693 24886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/wal
uuid: "f52531ad45d445749d6161a0a5950355"
format_stamp: "Formatted at 2026-08-11 01:01:01 on dist-test-slave-42z9"
server_key: "8e671c8470cdd7fbc12e80d058839b9d"
server_key_iv: "426cf3865d3e12636988b2fd08130044"
server_key_version: "encryptionkey@0"
I20260811 01:01:01.762750 24886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:01.768644 24886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:01.770534 24886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:01.773734 24886 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.188:33705
I20260811 01:01:01.774237 24886 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/master-2/data/info.pb
I20260811 01:01:01.774662 25165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.188:33705 every 8 connection(s)
I20260811 01:01:01.775339 25166 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:01:01.775765 25166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: Bootstrap starting.
I20260811 01:01:01.778172 25166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:01:01.778373 25166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: Bootstrap complete.
I20260811 01:01:01.778580 25166 raft_consensus.cc:348] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } }
I20260811 01:01:01.778657 25166 raft_consensus.cc:729] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f52531ad45d445749d6161a0a5950355, State: Initialized, Role: LEARNER
I20260811 01:01:01.778697 25166 consensus_queue.cc:260] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } }
I20260811 01:01:01.778878 25166 sys_catalog.cc:564] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:01:01.778877 25172 sys_catalog.cc:455] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } } }
I20260811 01:01:01.778970 25172 sys_catalog.cc:458] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [sys.catalog]: This master's current role is: LEARNER
I20260811 01:01:01.780360 25189 catalog_manager.cc:1259] Loaded cluster ID: aaf8e0969b664caf9eb6b9ac9ddd232b
I20260811 01:01:01.780408 25189 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: loading cluster ID for follower catalog manager: success
I20260811 01:01:01.781694 25189 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: acquiring CA information for follower catalog manager: success
I20260811 01:01:01.781980 25189 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 01:01:01.798525 25038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:01.798764 25038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:01.798800 25038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:01.800083 25038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:01.800139 25038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:01.800179 25038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:01:01.801977 25038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:44177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.129.keytab
--principal=oryx/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:36911
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=42987
--tserver_master_addrs=127.13.30.190:45431,127.13.30.189:37329,127.13.30.188:33705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:01.802227 25038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:01.802459 25038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:01.807562 25196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:01.807590 25195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:01.807651 25038 server_base.cc:1034] running on GCE node
W20260811 01:01:01.807562 25203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:01.807982 25038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:01.808197 25038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:01.809353 25038 hybrid_clock.cc:648] HybridClock initialized: now 1786410061809334 us; error 32 us; skew 500 ppm
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:01.812132 25038 init.cc:377] Logged in from keytab as oryx/127.13.30.129@KRBTEST.COM (short username oryx)
I20260811 01:01:01.812587 25038 webserver.cc:460] Webserver started at http://127.13.30.129:42987/ using document root <none> and password file <none>
I20260811 01:01:01.812783 25038 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:01.812841 25038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:01.814308 25038 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:01:01.814930 25213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:01.815126 25038 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:01:01.815222 25038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "3277febdecd149e0bd31853aefb16946"
format_stamp: "Formatted at 2026-08-11 01:01:00 on dist-test-slave-42z9"
server_key: "3df2b81bb06d2c6dfc64b3567370b65d"
server_key_iv: "bae1f94b3039ffba4350af14a968eab7"
server_key_version: "encryptionkey@0"
I20260811 01:01:01.815606 25038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:01.841763 25038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:01.843817 25038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:01.843973 25038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:01.844264 25038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:01.844607 25038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:01.844645 25038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:01.844667 25038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:01.844678 25038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:01.853614 25038 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:36911
I20260811 01:01:01.853708 25412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:36911 every 8 connection(s)
I20260811 01:01:01.854058 25038 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:01:01.861402 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 25038
I20260811 01:01:01.861615 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 24039
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.189@KRBTEST.COM
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.188@KRBTEST.COM
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:01.887387 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.855265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:53239 (local address 127.13.30.189:37329)
0811 01:01:01.855315 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.855316 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.855326 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:01:01.856444 (+ 1118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.856446 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.856460 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.856521 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.857328 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.858128 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.859373 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.859653 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.859721 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.877785 (+ 18064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.877787 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.877788 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.877796 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.885742 (+ 7946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.886367 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.886369 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.886369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.886434 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.886681 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.886682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.886683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.886828 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.886864 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.887210 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.887298 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 01:01:01.887957 25423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.854912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37329 (local address 127.13.30.129:53239)
0811 01:01:01.855210 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.855222 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.856333 (+ 1111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.856610 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.856611 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.856975 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.857206 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.857212 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.858226 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.858227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.859251 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.859254 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.859737 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.859738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.859882 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.860580 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.860586 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.877631 (+ 17045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.885891 (+ 8260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.885909 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.885913 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.886285 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.886496 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.886497 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.886497 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.886628 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.886902 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.886909 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.887079 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.887522 (+ 443us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.887722 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":97,"thread_start_us":132,"threads_started":1}
I20260811 01:01:01.888387 25417 heartbeater.cc:347] Connected to a master server at 127.13.30.189:37329
I20260811 01:01:01.888476 25417 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:01.888664 25417 heartbeater.cc:511] Master 127.13.30.189:37329 requested a full tablet report, sending...
I20260811 01:01:01.889127 24790 ts_manager.cc:194] Registered new tserver with Master: 3277febdecd149e0bd31853aefb16946 (127.13.30.129:36911)
I20260811 01:01:01.898063 25421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.854914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.129:35835)
0811 01:01:01.855139 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.855185 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.856313 (+ 1128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.856604 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.856608 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.856973 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.857205 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.857210 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.858193 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.858194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.859467 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.859469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.860176 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.860177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.860222 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.860704 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.860708 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.895077 (+ 34369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.896862 (+ 1785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.896862 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.896863 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.897075 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.897278 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.897279 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.897279 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.897328 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.897684 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.897686 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.897731 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.897805 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.897940 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":66,"thread_start_us":153,"threads_started":1}
I20260811 01:01:01.898249 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.855208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:35835 (local address 127.13.30.190:45431)
0811 01:01:01.855265 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.855267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.855278 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:01:01.856457 (+ 1179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.856459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.856471 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.856501 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.857301 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.858129 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.859566 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.859802 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.859872 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.895209 (+ 35337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.895212 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.895212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.895221 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.896758 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.897153 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.897154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.897154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.897214 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.897394 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.897395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.897395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.897585 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.897652 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.897860 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.897938 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 01:01:01.898564 25416 heartbeater.cc:347] Connected to a master server at 127.13.30.190:45431
I20260811 01:01:01.898623 25416 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:01.898706 25416 heartbeater.cc:511] Master 127.13.30.190:45431 requested a full tablet report, sending...
I20260811 01:01:01.898998 23691 ts_manager.cc:194] Re-registered known tserver with Master: 3277febdecd149e0bd31853aefb16946 (127.13.30.129:36911)
I20260811 01:01:01.899529 23691 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:35835
I20260811 01:01:01.900336 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.855342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:47535 (local address 127.13.30.188:33705)
0811 01:01:01.855490 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:01.855492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:01.855779 (+ 287us) server_negotiation.cc:407] Connection header received
0811 01:01:01.856511 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:01.856513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:01.856527 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:01.856599 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:01.857316 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.858063 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.859489 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.859809 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.859868 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.897099 (+ 37231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:01.897102 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:01.897102 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:01.897113 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:01.899083 (+ 1970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.899493 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.899495 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.899495 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.899563 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:01.899765 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:01.899766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:01.899767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:01.899920 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:01.899994 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:01.900151 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 01:01:01.900237 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":68,"threads_started":1}
I20260811 01:01:01.900343 25425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:01.854912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:33705 (local address 127.13.30.129:47535)
0811 01:01:01.855456 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:01.855465 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:01.856329 (+ 864us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:01.856614 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:01.856614 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:01.857018 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:01.857206 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.857212 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.858180 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.858181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.859400 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:01.859403 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:01.859885 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:01.859886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:01.859959 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:01.860524 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:01.860533 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:01.896746 (+ 36213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:01.899177 (+ 2431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.899178 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.899178 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.899418 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.899641 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:01.899642 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:01.899642 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:01.899704 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:01.899987 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:01.899989 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:01.900052 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 01:01:01.900113 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 01:01:01.900233 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"mutex_wait_us":517,"thread_start_us":74,"threads_started":1}
I20260811 01:01:01.900962 25414 heartbeater.cc:347] Connected to a master server at 127.13.30.188:33705
I20260811 01:01:01.901026 25414 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:01.901119 25414 heartbeater.cc:511] Master 127.13.30.188:33705 requested a full tablet report, sending...
I20260811 01:01:01.901608 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:39751
--local_ip_for_outbound_sockets=127.13.30.130
--tserver_master_addrs=127.13.30.190:45431
--webserver_port=40339
--webserver_interface=127.13.30.130
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.130.keytab
--principal=oryx/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:44177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.13.30.190:45431,127.13.30.189:37329
--tserver_master_addrs=127.13.30.190:45431,127.13.30.189:37329,127.13.30.188:33705 with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:01:01.901654 25102 ts_manager.cc:194] Registered new tserver with Master: 3277febdecd149e0bd31853aefb16946 (127.13.30.129:36911)
W20260811 01:01:01.991086 25433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:01.991326 25433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:01.991353 25433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:01.992622 25433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:01.992676 25433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:01.992702 25433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:01:01.994439 25433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:44177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.130.keytab
--principal=oryx/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:39751
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=40339
--tserver_master_addrs=127.13.30.190:45431,127.13.30.189:37329,127.13.30.188:33705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:01.994727 25433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:01.994983 25433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:02.000435 25446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:02.000435 25442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:02.000418 25444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:02.000864 25433 server_base.cc:1034] running on GCE node
I20260811 01:01:02.001101 25433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:02.001349 25433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:02.002501 25433 hybrid_clock.cc:648] HybridClock initialized: now 1786410062002487 us; error 31 us; skew 500 ppm
Aug 11 01:01:01 dist-test-slave-42z9 krb5kdc[23619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:02.005155 25433 init.cc:377] Logged in from keytab as oryx/127.13.30.130@KRBTEST.COM (short username oryx)
I20260811 01:01:02.005666 25433 webserver.cc:460] Webserver started at http://127.13.30.130:40339/ using document root <none> and password file <none>
I20260811 01:01:02.005896 25433 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:02.005967 25433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:02.007552 25433 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:01:02.008229 25455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:02.008504 25433 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:02.008595 25433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "0c1862260007427eb9f43a6f7309b47c"
format_stamp: "Formatted at 2026-08-11 01:01:00 on dist-test-slave-42z9"
server_key: "39f28c930a31d6d004520b0a93bc8dca"
server_key_iv: "437500593fb3105f0c46ab219b3f0755"
server_key_version: "encryptionkey@0"
I20260811 01:01:02.008989 25433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:02.030462 25433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:02.032588 25433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:02.032717 25433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:02.032980 25433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:02.033304 25433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:02.033339 25433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:02.033362 25433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:02.033384 25433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:02.041381 25433 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:39751
I20260811 01:01:02.041431 25645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:39751 every 8 connection(s)
I20260811 01:01:02.041854 25433 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:01:02.048776 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 25433
I20260811 01:01:02.048957 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 24282
Aug 11 01:01:02 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.188@KRBTEST.COM
Aug 11 01:01:02 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:02.060235 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.043007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:51315 (local address 127.13.30.190:45431)
0811 01:01:02.043054 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.043056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.043230 (+ 174us) server_negotiation.cc:407] Connection header received
0811 01:01:02.044223 (+ 993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.044224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.044237 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.044287 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:02.045052 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.045610 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.046901 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.047176 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.047228 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.057353 (+ 10125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:02.057356 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:02.057356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:02.057366 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:02.058793 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.059315 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.059316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.059317 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.059371 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.059591 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.059592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.059592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.059701 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:02.059733 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.060061 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.060146 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 01:01:02.060784 25654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.042690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.130:51315)
0811 01:01:02.043159 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:02.043167 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:02.044060 (+ 893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:02.044305 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:02.044306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:02.044710 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:02.044937 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.044942 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.045715 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.045716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.046812 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.046814 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.047260 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.047261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.047323 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.048004 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:02.048008 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:02.057179 (+ 9171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:02.058900 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:02.058912 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:02.058915 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:02.059221 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:02.059432 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:02.059433 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:02.059433 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:02.059540 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:02.059769 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:02.059775 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:02.059940 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 01:01:02.060382 (+ 442us) client_negotiation.cc:240] Negotiation successful
0811 01:01:02.060567 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"mutex_wait_us":316,"thread_start_us":79,"threads_started":1}
I20260811 01:01:02.061178 25648 heartbeater.cc:347] Connected to a master server at 127.13.30.190:45431
I20260811 01:01:02.061259 25648 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:02.061465 25648 heartbeater.cc:511] Master 127.13.30.190:45431 requested a full tablet report, sending...
I20260811 01:01:02.061805 23691 ts_manager.cc:194] Re-registered known tserver with Master: 0c1862260007427eb9f43a6f7309b47c (127.13.30.130:39751)
I20260811 01:01:02.062224 23691 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:51315
Aug 11 01:01:02 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410061, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.189@KRBTEST.COM
I20260811 01:01:02.069355 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.042760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:52823 (local address 127.13.30.189:37329)
0811 01:01:02.042810 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.042812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.043074 (+ 262us) server_negotiation.cc:407] Connection header received
0811 01:01:02.044149 (+ 1075us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.044151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.044165 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.044215 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:02.045034 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.045855 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.046766 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.047025 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.047093 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.066867 (+ 19774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:02.066869 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:02.066869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:02.066878 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:02.068266 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.068626 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.068627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.068627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.068681 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.068851 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.068852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.068853 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.068965 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:02.069021 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.069162 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.069251 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 01:01:02.069386 25651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.042690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37329 (local address 127.13.30.130:52823)
0811 01:01:02.042934 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:02.042980 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:02.044061 (+ 1081us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:02.044293 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:02.044298 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:02.044709 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:02.044936 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.044940 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.045962 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.045963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.046675 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.046677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.047131 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.047133 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.047265 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.047970 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:02.047981 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:02.066757 (+ 18776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:02.068382 (+ 1625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:02.068384 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:02.068384 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:02.068559 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:02.068736 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:02.068737 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:02.068737 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:02.068799 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:02.069023 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:02.069025 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:02.069074 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 01:01:02.069133 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 01:01:02.069253 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":12,"thread_start_us":77,"threads_started":1}
I20260811 01:01:02.070170 25649 heartbeater.cc:347] Connected to a master server at 127.13.30.189:37329
I20260811 01:01:02.070220 25649 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:02.070276 25649 heartbeater.cc:511] Master 127.13.30.189:37329 requested a full tablet report, sending...
I20260811 01:01:02.070636 24790 ts_manager.cc:194] Registered new tserver with Master: 0c1862260007427eb9f43a6f7309b47c (127.13.30.130:39751)
I20260811 01:01:02.080255 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:41971
--local_ip_for_outbound_sockets=127.13.30.131
--tserver_master_addrs=127.13.30.190:45431
--webserver_port=38577
--webserver_interface=127.13.30.131
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.131.keytab
--principal=oryx/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:44177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.13.30.190:45431,127.13.30.189:37329
--tserver_master_addrs=127.13.30.190:45431,127.13.30.189:37329,127.13.30.188:33705 with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:01:02.082226 25653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.042690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:33705 (local address 127.13.30.130:52789)
0811 01:01:02.042986 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:02.042997 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:02.044045 (+ 1048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:02.044294 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:02.044299 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:02.044716 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:02.044937 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.044942 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.045935 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.045936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.046821 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.046823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.047609 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.047610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.047690 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.048117 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:02.048121 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:02.078727 (+ 30606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:02.080979 (+ 2252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:02.080981 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:02.080982 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:02.081253 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:02.081511 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:02.081512 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:02.081512 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:02.081602 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:02.081870 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:02.081871 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:02.081931 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 01:01:02.082011 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 01:01:02.082131 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":54,"thread_start_us":84,"threads_started":1}
I20260811 01:01:02.082245 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.042950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:52789 (local address 127.13.30.188:33705)
0811 01:01:02.042993 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.042995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.043072 (+ 77us) server_negotiation.cc:407] Connection header received
0811 01:01:02.044159 (+ 1087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.044160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.044173 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.044203 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:02.045059 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.045847 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.047282 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.047496 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.047551 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.078867 (+ 31316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:02.078869 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:02.078870 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:02.078880 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:02.080857 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.081337 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.081338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.081339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.081416 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.081669 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.081669 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.081670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.081804 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:02.081872 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.082043 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.082145 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 01:01:02.082711 25646 heartbeater.cc:347] Connected to a master server at 127.13.30.188:33705
I20260811 01:01:02.082774 25646 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:02.082827 25646 heartbeater.cc:511] Master 127.13.30.188:33705 requested a full tablet report, sending...
I20260811 01:01:02.083133 25102 ts_manager.cc:194] Registered new tserver with Master: 0c1862260007427eb9f43a6f7309b47c (127.13.30.130:39751)
W20260811 01:01:02.167337 25657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:02.167579 25657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:02.167615 25657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:02.168874 25657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:02.168926 25657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:02.168962 25657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:01:02.170686 25657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:44177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.131.keytab
--principal=oryx/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:41971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=38577
--tserver_master_addrs=127.13.30.190:45431,127.13.30.189:37329,127.13.30.188:33705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:02.170951 25657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:02.171190 25657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:02.176734 25664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:02.176740 25666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:02.176774 25657 server_base.cc:1034] running on GCE node
W20260811 01:01:02.176736 25663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:02.177140 25657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:02.177384 25657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:02.178527 25657 hybrid_clock.cc:648] HybridClock initialized: now 1786410062178518 us; error 34 us; skew 500 ppm
Aug 11 01:01:02 dist-test-slave-42z9 krb5kdc[23619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410062, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:02.181298 25657 init.cc:377] Logged in from keytab as oryx/127.13.30.131@KRBTEST.COM (short username oryx)
I20260811 01:01:02.181797 25657 webserver.cc:460] Webserver started at http://127.13.30.131:38577/ using document root <none> and password file <none>
I20260811 01:01:02.182016 25657 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:02.182081 25657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:02.183406 25657 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:01:02.183947 25678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:02.184101 25657 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 01:01:02.184187 25657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "cc1367cabba94f7cbea786674b63dc89"
format_stamp: "Formatted at 2026-08-11 01:01:01 on dist-test-slave-42z9"
server_key: "7e4d7aa92fc9b0046f4641328bc2fff5"
server_key_iv: "a503798f0045c5de352c75892ffb02f4"
server_key_version: "encryptionkey@0"
I20260811 01:01:02.184566 25657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:02.198451 25657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:02.200773 25657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:02.200927 25657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:02.201179 25657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:02.201547 25657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:02.201587 25657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:02.201619 25657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:02.201642 25657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:02.208767 25657 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:41971
I20260811 01:01:02.208823 25881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:41971 every 8 connection(s)
I20260811 01:01:02.209182 25657 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
Aug 11 01:01:02 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410062, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:02.216614 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 25657
Aug 11 01:01:02 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410062, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.188@KRBTEST.COM
Aug 11 01:01:02 dist-test-slave-42z9 krb5kdc[23619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410062, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.189@KRBTEST.COM
I20260811 01:01:02.222002 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.210467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:39247 (local address 127.13.30.189:37329)
0811 01:01:02.210515 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.210517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.210609 (+ 92us) server_negotiation.cc:407] Connection header received
0811 01:01:02.211290 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.211292 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.211305 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.211367 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:02.212200 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.212713 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.213890 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.214110 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.214180 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.217826 (+ 3646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:02.217828 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:02.217828 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:02.217836 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:02.219520 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.220823 (+ 1303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.220825 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.220825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.220886 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.221169 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.221171 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.221171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.221310 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:02.221370 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.221807 (+ 437us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.221904 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 01:01:02.222165 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.210330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:47037 (local address 127.13.30.190:45431)
0811 01:01:02.210393 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.210395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.210937 (+ 542us) server_negotiation.cc:407] Connection header received
0811 01:01:02.211305 (+ 368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.211307 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.211317 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.211344 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:02.212217 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.212977 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.214096 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.214341 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.214390 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.218847 (+ 4457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:02.218848 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:02.218849 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:02.218857 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:02.220650 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.221013 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.221014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.221014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.221067 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.221255 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.221256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.221257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.221395 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:02.221459 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.221996 (+ 537us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.222079 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 01:01:02.222235 25889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.210133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37329 (local address 127.13.30.131:39247)
0811 01:01:02.210471 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:02.210518 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:02.211188 (+ 670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:02.211455 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:02.211460 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:02.211853 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:02.212107 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.212112 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.212832 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.212834 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.213799 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.213802 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.214187 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.214188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.214300 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.215066 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:02.215077 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:02.217656 (+ 2579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:02.220390 (+ 2734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:02.220402 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:02.220405 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:02.220731 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:02.220954 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:02.220955 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:02.220955 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:02.221101 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:02.221397 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:02.221405 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:02.221639 (+ 234us) client_negotiation.cc:769] Sending connection context
0811 01:01:02.221762 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 01:01:02.221978 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":1,"thread_start_us":67,"threads_started":1}
I20260811 01:01:02.222527 25891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.210038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.131:47037)
0811 01:01:02.210887 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:02.210897 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:02.211198 (+ 301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:02.211474 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:02.211475 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:02.211887 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:02.212108 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.212114 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.213078 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.213079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.214012 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.214014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.214413 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.214414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.214471 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.215066 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:02.215077 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:02.218724 (+ 3647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:02.220739 (+ 2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:02.220739 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:02.220740 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:02.220932 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:02.221132 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:02.221133 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:02.221134 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:02.221186 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:02.221504 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:02.221505 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:02.221639 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 01:01:02.222281 (+ 642us) client_negotiation.cc:240] Negotiation successful
0811 01:01:02.222420 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":822,"mutex_wait_us":333,"thread_start_us":59,"threads_started":1}
I20260811 01:01:02.222678 25887 heartbeater.cc:347] Connected to a master server at 127.13.30.189:37329
I20260811 01:01:02.222944 25887 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:02.223206 25884 heartbeater.cc:347] Connected to a master server at 127.13.30.190:45431
I20260811 01:01:02.223258 25884 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:02.223482 25884 heartbeater.cc:511] Master 127.13.30.190:45431 requested a full tablet report, sending...
I20260811 01:01:02.223713 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.210158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:48145 (local address 127.13.30.188:33705)
0811 01:01:02.210224 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.210226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.210814 (+ 588us) server_negotiation.cc:407] Connection header received
0811 01:01:02.211369 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.211371 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.211383 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.211431 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:02.212219 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.212981 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.214441 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.214670 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.214733 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.217421 (+ 2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:02.217423 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:02.217424 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:02.217433 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:02.220314 (+ 2881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.222861 (+ 2547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.222863 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.222864 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.222936 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.223145 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.223146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.223146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.223287 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:02.223335 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.223538 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.223629 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 01:01:02.223878 23691 ts_manager.cc:194] Re-registered known tserver with Master: cc1367cabba94f7cbea786674b63dc89 (127.13.30.131:41971)
I20260811 01:01:02.224036 25890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.210038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:33705 (local address 127.13.30.131:48145)
0811 01:01:02.210472 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:02.210518 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:02.211188 (+ 670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:02.211845 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:02.211846 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:02.211987 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:02.212108 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.212114 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.213078 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.213079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.214012 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.214014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.214730 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.214731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.214790 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.215153 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:02.215156 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:02.217288 (+ 2132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:02.222519 (+ 5231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:02.222520 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:02.222521 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:02.222751 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:02.223014 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:02.223015 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:02.223015 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:02.223078 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:02.223382 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:02.223383 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:02.223426 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 01:01:02.223814 (+ 388us) client_negotiation.cc:240] Negotiation successful
0811 01:01:02.223926 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":43,"thread_start_us":100,"threads_started":1}
I20260811 01:01:02.224289 23691 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:47037
I20260811 01:01:02.224385 25882 heartbeater.cc:347] Connected to a master server at 127.13.30.188:33705
I20260811 01:01:02.224442 25882 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:02.224514 25882 heartbeater.cc:511] Master 127.13.30.188:33705 requested a full tablet report, sending...
I20260811 01:01:02.224525 25887 heartbeater.cc:511] Master 127.13.30.189:37329 requested a full tablet report, sending...
I20260811 01:01:02.224792 25102 ts_manager.cc:194] Registered new tserver with Master: cc1367cabba94f7cbea786674b63dc89 (127.13.30.131:41971)
I20260811 01:01:02.225380 24790 ts_manager.cc:194] Registered new tserver with Master: cc1367cabba94f7cbea786674b63dc89 (127.13.30.131:41971)
I20260811 01:01:02.228432 25903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.217783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33776 (local address 127.13.30.190:45431)
0811 01:01:02.218086 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.218088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.218251 (+ 163us) server_negotiation.cc:407] Connection header received
0811 01:01:02.218276 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.218277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.218289 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.218354 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:02.219242 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.220038 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.221025 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.221307 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.221362 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.223378 (+ 2016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:02.223379 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:02.223379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:02.223387 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:02.226410 (+ 3023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.227129 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.227130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.227131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.227188 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.227607 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.227608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.227608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.227768 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:02.227894 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.228110 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.228215 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":72,"threads_started":1}
I20260811 01:01:02.230139 25909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.218292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37946 (local address 127.13.30.189:37329)
0811 01:01:02.218566 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.218569 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.218978 (+ 409us) server_negotiation.cc:407] Connection header received
0811 01:01:02.219001 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.219002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.219014 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.219066 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:02.221227 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.221964 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.224896 (+ 2932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.225202 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.225262 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.226783 (+ 1521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:02.226784 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:02.226784 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:02.226793 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:02.228765 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.229177 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.229179 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.229179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.229246 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.229488 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.229489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.229490 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.229639 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:02.229750 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.229932 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.230037 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":98,"threads_started":1}
I20260811 01:01:02.231001 25902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.217766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44170 (local address 127.13.30.188:33705)
0811 01:01:02.218036 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.218038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.218719 (+ 681us) server_negotiation.cc:407] Connection header received
0811 01:01:02.218744 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.218744 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.218757 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.218812 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:02.219753 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.220457 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.225332 (+ 4875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.225655 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.225723 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.226884 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:02.226886 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:02.226886 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:02.226894 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:02.229231 (+ 2337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.229987 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.229989 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.229989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.230058 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.230329 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.230331 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.230331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.230526 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:02.230623 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.230724 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.230906 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":61,"threads_started":1}
I20260811 01:01:02.230120 23691 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33776:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:01:02.232225 23691 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:01:02.240411 25925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.236455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53368 (local address 127.13.30.130:39751)
0811 01:01:02.236696 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.236701 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.236931 (+ 230us) server_negotiation.cc:407] Connection header received
0811 01:01:02.236978 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.236980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.236996 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.237065 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:02.237238 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.238005 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.239431 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.239973 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.240050 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.240129 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.240282 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.240327 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":111,"threads_started":1}
I20260811 01:01:02.240401 25918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.236230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:39751 (local address 127.0.0.1:53368)
0811 01:01:02.236805 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:02.236814 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:02.236875 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:02.237127 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:02.237128 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:02.237130 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:02.237173 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.237174 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.238090 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.238091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.239352 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.239354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.240062 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.240063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.240203 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.240208 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:01:02.240258 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 01:01:02.240307 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":96,"threads_started":1}
I20260811 01:01:02.240593 25921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.236094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50718 (local address 127.13.30.131:41971)
0811 01:01:02.236295 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.236301 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.236311 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:01:02.236418 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.236420 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.236440 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.236525 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:02.236733 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.237869 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.239236 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.239998 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.240067 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.240205 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.240456 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.240506 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":96,"threads_started":1}
I20260811 01:01:02.240715 25923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.236101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56080 (local address 127.13.30.129:36911)
0811 01:01:02.236295 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.236301 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.236446 (+ 145us) server_negotiation.cc:407] Connection header received
0811 01:01:02.236645 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.236648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.236664 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.236718 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:02.237075 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.238429 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.239524 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.240215 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.240278 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.240363 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.240535 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.240584 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":89,"threads_started":1}
I20260811 01:01:02.240774 25920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.235987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:41971 (local address 127.0.0.1:50718)
0811 01:01:02.236174 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:02.236185 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:02.236233 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:02.236596 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:02.236596 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:02.236598 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:02.236652 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.236654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.237967 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.237968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.239144 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.239147 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.240246 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.240247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.240311 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.240316 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:01:02.240362 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:01:02.240408 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":24,"thread_start_us":96,"threads_started":1}
I20260811 01:01:02.240936 25924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.235994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:36911 (local address 127.0.0.1:56080)
0811 01:01:02.236370 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:02.236381 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:02.236474 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:02.236889 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:02.236890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:02.236891 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:02.236993 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.236995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.238518 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.238519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.239383 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.239386 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.240394 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.240395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.240448 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.240451 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:01:02.240832 (+ 381us) client_negotiation.cc:240] Negotiation successful
0811 01:01:02.240879 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":143,"threads_started":1}
I20260811 01:01:02.241577 25302 tablet_service.cc:1467] Processing CreateTablet for tablet 410c01124e1d46f9b82cbceda92db2e2 (DEFAULT_TABLE table=test-table [id=6ab2e90e34db4d1597bf0ba2949ed283]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:02.241650 25544 tablet_service.cc:1467] Processing CreateTablet for tablet 410c01124e1d46f9b82cbceda92db2e2 (DEFAULT_TABLE table=test-table [id=6ab2e90e34db4d1597bf0ba2949ed283]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:02.241742 25763 tablet_service.cc:1467] Processing CreateTablet for tablet 410c01124e1d46f9b82cbceda92db2e2 (DEFAULT_TABLE table=test-table [id=6ab2e90e34db4d1597bf0ba2949ed283]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:02.242022 25302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 410c01124e1d46f9b82cbceda92db2e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:02.242030 25544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 410c01124e1d46f9b82cbceda92db2e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:02.242066 25763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 410c01124e1d46f9b82cbceda92db2e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:02.245057 25928 tablet_bootstrap.cc:492] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c: Bootstrap starting.
I20260811 01:01:02.245802 25929 tablet_bootstrap.cc:492] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89: Bootstrap starting.
I20260811 01:01:02.246018 25928 tablet_bootstrap.cc:654] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:02.246305 25932 tablet_bootstrap.cc:492] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946: Bootstrap starting.
I20260811 01:01:02.246456 25928 log.cc:824] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:02.246739 25929 tablet_bootstrap.cc:654] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:02.247045 25932 tablet_bootstrap.cc:654] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:02.247191 25929 log.cc:824] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:02.247457 25928 tablet_bootstrap.cc:492] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c: No bootstrap required, opened a new log
I20260811 01:01:02.247512 25932 log.cc:824] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:02.247537 25928 ts_tablet_manager.cc:1397] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 01:01:02.247970 25929 tablet_bootstrap.cc:492] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89: No bootstrap required, opened a new log
I20260811 01:01:02.248042 25929 ts_tablet_manager.cc:1397] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:01:02.248339 25932 tablet_bootstrap.cc:492] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946: No bootstrap required, opened a new log
I20260811 01:01:02.248410 25932 ts_tablet_manager.cc:1397] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:01:02.249818 25928 raft_consensus.cc:348] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } }
I20260811 01:01:02.250000 25928 raft_consensus.cc:374] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:02.250044 25928 raft_consensus.cc:729] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c1862260007427eb9f43a6f7309b47c, State: Initialized, Role: FOLLOWER
I20260811 01:01:02.250183 25928 consensus_queue.cc:260] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } }
I20260811 01:01:02.250466 25928 ts_tablet_manager.cc:1428] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 01:01:02.250460 25929 raft_consensus.cc:348] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } }
I20260811 01:01:02.250617 25648 heartbeater.cc:503] Master 127.13.30.190:45431 was elected leader, sending a full tablet report...
I20260811 01:01:02.250617 25929 raft_consensus.cc:374] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:02.250655 25929 raft_consensus.cc:729] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1367cabba94f7cbea786674b63dc89, State: Initialized, Role: FOLLOWER
I20260811 01:01:02.250780 25929 consensus_queue.cc:260] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } }
I20260811 01:01:02.250926 25932 raft_consensus.cc:348] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } }
I20260811 01:01:02.251088 25929 ts_tablet_manager.cc:1428] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:01:02.251103 25932 raft_consensus.cc:374] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:02.251155 25932 raft_consensus.cc:729] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3277febdecd149e0bd31853aefb16946, State: Initialized, Role: FOLLOWER
I20260811 01:01:02.251405 25884 heartbeater.cc:503] Master 127.13.30.190:45431 was elected leader, sending a full tablet report...
I20260811 01:01:02.251829 25932 consensus_queue.cc:260] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } }
I20260811 01:01:02.252174 25932 ts_tablet_manager.cc:1428] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 01:01:02.252202 25416 heartbeater.cc:503] Master 127.13.30.190:45431 was elected leader, sending a full tablet report...
I20260811 01:01:02.264786 25920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.262236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:33705 (local address 127.0.0.1:44176)
0811 01:01:02.262296 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:02.262312 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:02.262386 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:02.262563 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:02.262564 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:02.262565 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:02.262622 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.262623 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.263266 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.263267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.264053 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.264056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.264607 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.264607 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.264650 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.264653 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:01:02.264678 (+ 25us) client_negotiation.cc:240] Negotiation successful
0811 01:01:02.264717 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 01:01:02.264784 25902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.262305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44176 (local address 127.13.30.188:33705)
0811 01:01:02.262365 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.262367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.262375 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:01:02.262446 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.262448 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.262477 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.262547 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:02.262662 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.263192 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.264123 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.264543 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.264602 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.264666 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.264690 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.264722 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 01:01:02.265218 25120 raft_consensus.cc:1203] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260811 01:01:02.266814 25172 sys_catalog.cc:455] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 515d747c628940349bea50bbfcd1e591. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } } }
I20260811 01:01:02.266952 25172 sys_catalog.cc:458] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [sys.catalog]: This master's current role is: LEARNER
W20260811 01:01:02.293319 25650 tablet.cc:2369] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:01:02.355543 25419 tablet.cc:2369] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:01:02.430806 25939 raft_consensus.cc:482] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:01:02.430984 25939 raft_consensus.cc:504] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } }
I20260811 01:01:02.431372 25939 leader_election.cc:288] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3277febdecd149e0bd31853aefb16946 (127.13.30.129:36911), 0c1862260007427eb9f43a6f7309b47c (127.13.30.130:39751)
I20260811 01:01:02.434402 25890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.431598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:36911 (local address 127.13.30.131:58181)
0811 01:01:02.431660 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:02.431675 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:02.431744 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:02.431917 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:02.431918 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:02.431920 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:02.432015 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.432017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.432735 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.432736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.433547 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.433550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.434140 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.434141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.434223 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.434228 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:01:02.434286 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 01:01:02.434334 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 01:01:02.434427 25923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.431697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:58181 (local address 127.13.30.129:36911)
0811 01:01:02.431747 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.431750 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.431783 (+ 33us) server_negotiation.cc:407] Connection header received
0811 01:01:02.431814 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.431815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.431825 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.431882 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:02.432120 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.432649 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.433636 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.434062 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.434119 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.434127 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.434307 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.434348 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 01:01:02.434583 25925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.431826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:39049 (local address 127.13.30.130:39751)
0811 01:01:02.431885 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.431887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.431896 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:02.431920 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.431921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.431938 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.431997 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:02.432210 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.432677 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.433783 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.434236 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.434301 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.434311 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.434472 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.434520 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 01:01:02.434588 25891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.431712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:39751 (local address 127.13.30.131:39049)
0811 01:01:02.431755 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:02.431765 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:02.431800 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:02.432059 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:02.432060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:02.432062 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:02.432132 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.432134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.432758 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.432759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.433681 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:02.433684 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.434312 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.434313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:02.434394 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.434398 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:01:02.434455 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 01:01:02.434514 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 01:01:02.434863 25339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "410c01124e1d46f9b82cbceda92db2e2" candidate_uuid: "cc1367cabba94f7cbea786674b63dc89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3277febdecd149e0bd31853aefb16946" is_pre_election: true
I20260811 01:01:02.434914 25573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "410c01124e1d46f9b82cbceda92db2e2" candidate_uuid: "cc1367cabba94f7cbea786674b63dc89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c1862260007427eb9f43a6f7309b47c" is_pre_election: true
I20260811 01:01:02.435045 25339 raft_consensus.cc:2454] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1367cabba94f7cbea786674b63dc89 in term 0.
I20260811 01:01:02.435065 25573 raft_consensus.cc:2454] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1367cabba94f7cbea786674b63dc89 in term 0.
I20260811 01:01:02.435281 25681 leader_election.cc:302] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c1862260007427eb9f43a6f7309b47c, cc1367cabba94f7cbea786674b63dc89; no voters:
I20260811 01:01:02.435418 25939 raft_consensus.cc:2781] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:01:02.435482 25939 raft_consensus.cc:482] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:01:02.435505 25939 raft_consensus.cc:3037] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:02.436275 25939 raft_consensus.cc:504] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } }
I20260811 01:01:02.436411 25939 leader_election.cc:288] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [CANDIDATE]: Term 1 election: Requested vote from peers 3277febdecd149e0bd31853aefb16946 (127.13.30.129:36911), 0c1862260007427eb9f43a6f7309b47c (127.13.30.130:39751)
I20260811 01:01:02.436609 25339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "410c01124e1d46f9b82cbceda92db2e2" candidate_uuid: "cc1367cabba94f7cbea786674b63dc89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3277febdecd149e0bd31853aefb16946"
I20260811 01:01:02.436681 25573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "410c01124e1d46f9b82cbceda92db2e2" candidate_uuid: "cc1367cabba94f7cbea786674b63dc89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c1862260007427eb9f43a6f7309b47c"
I20260811 01:01:02.436713 25339 raft_consensus.cc:3037] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:02.436755 25573 raft_consensus.cc:3037] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:02.437774 25339 raft_consensus.cc:2454] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1367cabba94f7cbea786674b63dc89 in term 1.
I20260811 01:01:02.437774 25573 raft_consensus.cc:2454] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1367cabba94f7cbea786674b63dc89 in term 1.
I20260811 01:01:02.437970 25681 leader_election.cc:302] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3277febdecd149e0bd31853aefb16946, cc1367cabba94f7cbea786674b63dc89; no voters:
I20260811 01:01:02.438081 25939 raft_consensus.cc:2781] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:01:02.438234 25939 raft_consensus.cc:686] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [term 1 LEADER]: Becoming Leader. State: Replica: cc1367cabba94f7cbea786674b63dc89, State: Running, Role: LEADER
I20260811 01:01:02.438510 25939 consensus_queue.cc:237] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } }
I20260811 01:01:02.439400 23691 catalog_manager.cc:5495] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc1367cabba94f7cbea786674b63dc89 (127.13.30.131). New cstate: current_term: 1 leader_uuid: "cc1367cabba94f7cbea786674b63dc89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260811 01:01:02.440065 25912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: NON_VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: true } } }
I20260811 01:01:02.440165 25912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:02.441205 25042 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591: attempting to promote NON_VOTER f52531ad45d445749d6161a0a5950355 to VOTER
I20260811 01:01:02.441334 25042 consensus_queue.cc:237] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } }
I20260811 01:01:02.441763 24808 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 FOLLOWER]: Refusing update from remote peer 515d747c628940349bea50bbfcd1e591: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 01:01:02.442021 25117 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 1 LEARNER]: Refusing update from remote peer 515d747c628940349bea50bbfcd1e591: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 01:01:02.442214 25951 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 01:01:02.442391 25954 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 01:01:02.443041 25954 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, f52531ad45d445749d6161a0a5950355 (127.13.30.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } } }
I20260811 01:01:02.443184 24808 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, f52531ad45d445749d6161a0a5950355 (127.13.30.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } } }
I20260811 01:01:02.443192 25117 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, f52531ad45d445749d6161a0a5950355 (127.13.30.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } } }
I20260811 01:01:02.444083 25172 sys_catalog.cc:455] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } } }
I20260811 01:01:02.444164 25172 sys_catalog.cc:458] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:01:02.444113 25954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } } }
I20260811 01:01:02.444192 25954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:02.444265 25951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } } }
I20260811 01:01:02.444319 25951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:02.444437 25912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } } }
I20260811 01:01:02.444512 25912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:02.444564 25957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "515d747c628940349bea50bbfcd1e591" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } } }
I20260811 01:01:02.444648 25957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 01:01:02.460625 25888 tablet.cc:2369] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:01:02.468515 25921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.466234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50734 (local address 127.13.30.131:41971)
0811 01:01:02.466290 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.466292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.466299 (+ 7us) server_negotiation.cc:407] Connection header received
0811 01:01:02.466340 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.466341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.466366 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.466443 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:01:02.466590 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.467094 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.467864 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.468056 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.468103 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.468234 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:01:02.468338 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:01:02.468399 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.468411 (+ 12us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.468433 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 01:01:02.470641 25573 raft_consensus.cc:1261] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c [term 1 FOLLOWER]: Refusing update from remote peer cc1367cabba94f7cbea786674b63dc89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:02.470641 25339 raft_consensus.cc:1261] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946 [term 1 FOLLOWER]: Refusing update from remote peer cc1367cabba94f7cbea786674b63dc89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:02.471017 25939 consensus_queue.cc:1035] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:02.471182 25948 consensus_queue.cc:1035] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:02.474414 25962 mvcc.cc:205] Tried to move back new op lower bound from 7317135615876747264 to 7317135615748911104. Current Snapshot: MvccSnapshot[applied={T|T < 7317135615876747264}]
I20260811 01:01:02.474622 25968 mvcc.cc:205] Tried to move back new op lower bound from 7317135615876747264 to 7317135615748911104. Current Snapshot: MvccSnapshot[applied={T|T < 7317135615876747264}]
I20260811 01:01:02.474890 25965 mvcc.cc:205] Tried to move back new op lower bound from 7317135615876747264 to 7317135615748911104. Current Snapshot: MvccSnapshot[applied={T|T < 7317135615876747264}]
I20260811 01:01:02.477842 23691 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:01:02.477958 23691 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:01:02.479609 23691 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 515d747c628940349bea50bbfcd1e591: Sending DeleteTablet for 3 replicas of tablet 410c01124e1d46f9b82cbceda92db2e2
I20260811 01:01:02.479983 25763 tablet_service.cc:1514] Processing DeleteTablet for tablet 410c01124e1d46f9b82cbceda92db2e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:02 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:50718
I20260811 01:01:02.480499 25302 tablet_service.cc:1514] Processing DeleteTablet for tablet 410c01124e1d46f9b82cbceda92db2e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:02 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:56080
I20260811 01:01:02.480552 25982 tablet_replica.cc:330] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89: stopping tablet replica
I20260811 01:01:02.480832 25982 raft_consensus.cc:2229] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:01:02.480883 25544 tablet_service.cc:1514] Processing DeleteTablet for tablet 410c01124e1d46f9b82cbceda92db2e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:02 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:53368
I20260811 01:01:02.481083 25982 raft_consensus.cc:2258] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:02.481536 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 23644
I20260811 01:01:02.481727 25983 tablet_replica.cc:330] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946: stopping tablet replica
I20260811 01:01:02.481950 25983 raft_consensus.cc:2229] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:02.482074 25983 raft_consensus.cc:2258] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:02.482246 25985 tablet_replica.cc:330] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c: stopping tablet replica
I20260811 01:01:02.482357 25985 raft_consensus.cc:2229] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:02.482462 25985 raft_consensus.cc:2258] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:02.492614 25985 ts_tablet_manager.cc:1905] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:02.494752 25985 ts_tablet_manager.cc:1918] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:01:02.494858 25985 log.cc:1196] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/410c01124e1d46f9b82cbceda92db2e2
I20260811 01:01:02.495138 25985 ts_tablet_manager.cc:1939] T 410c01124e1d46f9b82cbceda92db2e2 P 0c1862260007427eb9f43a6f7309b47c: Deleting consensus metadata
I20260811 01:01:02.497061 25983 ts_tablet_manager.cc:1905] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:02.497069 25982 ts_tablet_manager.cc:1905] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:02.498786 25983 ts_tablet_manager.cc:1918] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:01:02.498886 25983 log.cc:1196] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-0/wal/wals/410c01124e1d46f9b82cbceda92db2e2
I20260811 01:01:02.499181 25983 ts_tablet_manager.cc:1939] T 410c01124e1d46f9b82cbceda92db2e2 P 3277febdecd149e0bd31853aefb16946: Deleting consensus metadata
I20260811 01:01:02.499886 25982 ts_tablet_manager.cc:1918] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:01:02.499991 25982 log.cc:1196] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/410c01124e1d46f9b82cbceda92db2e2
I20260811 01:01:02.500324 25982 ts_tablet_manager.cc:1939] T 410c01124e1d46f9b82cbceda92db2e2 P cc1367cabba94f7cbea786674b63dc89: Deleting consensus metadata
W20260811 01:01:02.507933 25458 connection.cc:535] server connection from 127.0.0.1:53368 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 01:01:02.508244 25218 connection.cc:535] server connection from 127.0.0.1:56080 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 01:01:02.508504 25683 connection.cc:535] server connection from 127.0.0.1:50718 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 01:01:02.513839 25902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.480966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44188 (local address 127.13.30.188:33705)
0811 01:01:02.481008 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.481010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.505813 (+ 24803us) server_negotiation.cc:407] Connection header received
0811 01:01:02.505894 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.505896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.505912 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.505999 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:02.506812 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.507543 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.508640 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.508956 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.509000 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.510735 (+ 1735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:02.510736 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:02.510737 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:02.510746 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:02.512424 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.512825 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.512826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.512827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.512953 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.513174 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.513175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.513175 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.513310 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:02.513382 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.513645 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.513739 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 01:01:02.518977 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.510588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44198 (local address 127.13.30.188:33705)
0811 01:01:02.510629 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.510631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.511245 (+ 614us) server_negotiation.cc:407] Connection header received
0811 01:01:02.511268 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.511269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.511277 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.511324 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:02.512140 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.512883 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.514317 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.514580 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.514615 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.516257 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:02.516258 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:02.516258 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:02.516266 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:02.517759 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.518114 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.518115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.518116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.518179 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.518378 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.518378 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.518379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.518518 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:02.518596 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.518794 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.518878 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 01:01:02.519255 25909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:02.510467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37960 (local address 127.13.30.189:37329)
0811 01:01:02.510524 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:02.510526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:02.510863 (+ 337us) server_negotiation.cc:407] Connection header received
0811 01:01:02.510972 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:02.510973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:02.510988 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:02.511365 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:02.512463 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.513176 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.514153 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:02.514454 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:02.514503 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:02.516251 (+ 1748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:02.516253 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:02.516253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:02.516262 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:02.518053 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.518392 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.518393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.518393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.518468 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:02.518650 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:02.518650 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:02.518651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:02.518786 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:02.518876 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:02.519074 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 01:01:02.519171 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 01:01:03.476461 25997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.476060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.131:52357)
0811 01:01:03.476292 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:03.476399 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":72,"threads_started":1}
W20260811 01:01:03.476686 25884 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:45431 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
I20260811 01:01:03.476693 25998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.476248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.130:56999)
0811 01:01:03.476409 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:03.476479 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":48,"threads_started":1}
W20260811 01:01:03.476874 25648 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:45431 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
I20260811 01:01:03.476944 26001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.476523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.129:51671)
0811 01:01:03.476816 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:03.476904 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":58,"threads_started":1}
W20260811 01:01:03.477133 25416 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:45431 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
I20260811 01:01:03.980176 26003 raft_consensus.cc:482] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 515d747c628940349bea50bbfcd1e591)
I20260811 01:01:03.980367 26004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 515d747c628940349bea50bbfcd1e591)
I20260811 01:01:03.980365 26003 raft_consensus.cc:504] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } }
I20260811 01:01:03.980502 26004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } }
I20260811 01:01:03.980726 26003 leader_election.cc:288] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 515d747c628940349bea50bbfcd1e591 (127.13.30.190:45431), 70fe788d37cf432fa2812890a2d12953 (127.13.30.189:37329)
I20260811 01:01:03.981118 26007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.980861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:34292)
0811 01:01:03.980984 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:03.981071 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":50,"threads_started":1}
I20260811 01:01:03.981129 26004 leader_election.cc:288] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 515d747c628940349bea50bbfcd1e591 (127.13.30.190:45431), f52531ad45d445749d6161a0a5950355 (127.13.30.188:33705)
W20260811 01:01:03.981384 25076 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
I20260811 01:01:03.981536 26009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.981097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:34294)
0811 01:01:03.981402 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:03.981498 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":46,"threads_started":1}
W20260811 01:01:03.981638 24764 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
I20260811 01:01:03.982007 26007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.981906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:34304)
0811 01:01:03.981944 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:03.981967 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 01:01:03.982102 26009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.982018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:34312)
0811 01:01:03.982053 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:03.982077 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 01:01:03.982156 25076 leader_election.cc:334] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 515d747c628940349bea50bbfcd1e591 (127.13.30.190:45431): Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
W20260811 01:01:03.982167 24764 leader_election.cc:334] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 515d747c628940349bea50bbfcd1e591 (127.13.30.190:45431): Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
I20260811 01:01:03.983980 26015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.980906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:33705 (local address 127.0.0.1:44200)
0811 01:01:03.981229 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:03.981239 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:03.981309 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:03.981528 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:03.981529 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:03.981531 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:03.981585 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:03.981587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:03.982442 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:03.982443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:03.983209 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:03.983211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:03.983731 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:03.983732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:03.983787 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:03.983790 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:01:03.983835 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 01:01:03.983883 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":60,"threads_started":1}
I20260811 01:01:03.984016 26012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.980993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37972 (local address 127.13.30.189:37329)
0811 01:01:03.981249 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:03.981251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:03.981258 (+ 7us) server_negotiation.cc:407] Connection header received
0811 01:01:03.981286 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:03.981286 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:03.981299 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:03.981353 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:03.981600 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:03.982350 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:03.983303 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:03.983658 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:03.983719 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:03.983734 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:03.983857 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 01:01:03.983890 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":31,"threads_started":1}
I20260811 01:01:03.984004 26008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.980896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37329 (local address 127.0.0.1:37972)
0811 01:01:03.981080 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:03.981089 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:03.981155 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:03.981410 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:03.981411 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:03.981414 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:03.981513 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:03.981516 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:03.982434 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:03.982435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:03.983210 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:03.983212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:03.983731 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:03.983732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:03.983795 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:03.983798 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:01:03.983846 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 01:01:03.983906 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":17,"thread_start_us":64,"threads_started":1}
I20260811 01:01:03.984004 26014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.981058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44200 (local address 127.13.30.188:33705)
0811 01:01:03.981204 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:03.981206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:03.981306 (+ 100us) server_negotiation.cc:407] Connection header received
0811 01:01:03.981371 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:03.981372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:03.981382 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:03.981480 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:03.981662 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:03.982378 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:03.983292 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:03.983657 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:03.983716 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:03.983729 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:03.983847 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 01:01:03.983902 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":126,"thread_start_us":49,"threads_started":1}
I20260811 01:01:03.984300 24808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f52531ad45d445749d6161a0a5950355" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "70fe788d37cf432fa2812890a2d12953" is_pre_election: true
I20260811 01:01:03.984428 24808 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f52531ad45d445749d6161a0a5950355 in term 1.
I20260811 01:01:03.984404 25117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "70fe788d37cf432fa2812890a2d12953" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f52531ad45d445749d6161a0a5950355" is_pre_election: true
I20260811 01:01:03.984501 25117 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70fe788d37cf432fa2812890a2d12953 in term 1.
I20260811 01:01:03.984604 25077 leader_election.cc:302] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70fe788d37cf432fa2812890a2d12953, f52531ad45d445749d6161a0a5950355; no voters: 515d747c628940349bea50bbfcd1e591
I20260811 01:01:03.984650 24770 leader_election.cc:302] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70fe788d37cf432fa2812890a2d12953, f52531ad45d445749d6161a0a5950355; no voters: 515d747c628940349bea50bbfcd1e591
I20260811 01:01:03.984757 26004 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 01:01:03.984762 26003 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 01:01:03.984800 26003 raft_consensus.cc:482] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 515d747c628940349bea50bbfcd1e591)
I20260811 01:01:03.984802 26004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 515d747c628940349bea50bbfcd1e591)
I20260811 01:01:03.984820 26003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:01:03.984823 26004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:01:03.985589 26004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } }
I20260811 01:01:03.985611 26003 raft_consensus.cc:504] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } }
I20260811 01:01:03.985728 26004 leader_election.cc:288] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [CANDIDATE]: Term 2 election: Requested vote from peers 515d747c628940349bea50bbfcd1e591 (127.13.30.190:45431), f52531ad45d445749d6161a0a5950355 (127.13.30.188:33705)
I20260811 01:01:03.985734 26003 leader_election.cc:288] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [CANDIDATE]: Term 2 election: Requested vote from peers 515d747c628940349bea50bbfcd1e591 (127.13.30.190:45431), 70fe788d37cf432fa2812890a2d12953 (127.13.30.189:37329)
I20260811 01:01:03.985900 25117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "70fe788d37cf432fa2812890a2d12953" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f52531ad45d445749d6161a0a5950355"
I20260811 01:01:03.986006 25117 raft_consensus.cc:2379] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 70fe788d37cf432fa2812890a2d12953 in current term 2: Already voted for candidate f52531ad45d445749d6161a0a5950355 in this term.
I20260811 01:01:03.985985 24808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f52531ad45d445749d6161a0a5950355" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "70fe788d37cf432fa2812890a2d12953"
I20260811 01:01:03.986081 24808 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f52531ad45d445749d6161a0a5950355 in current term 2: Already voted for candidate 70fe788d37cf432fa2812890a2d12953 in this term.
I20260811 01:01:03.986145 26008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.985832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:34314)
0811 01:01:03.986089 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:03.986121 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 01:01:03.986284 26015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.985839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:34316)
0811 01:01:03.986229 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:03.986259 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373}
I20260811 01:01:03.986439 26008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.986352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:34326)
0811 01:01:03.986391 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:03.986414 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 01:01:03.986505 25076 leader_election.cc:334] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 515d747c628940349bea50bbfcd1e591 (127.13.30.190:45431): Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
I20260811 01:01:03.986541 25076 leader_election.cc:302] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f52531ad45d445749d6161a0a5950355; no voters: 515d747c628940349bea50bbfcd1e591, 70fe788d37cf432fa2812890a2d12953
I20260811 01:01:03.986565 26015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:03.986479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:34334)
0811 01:01:03.986520 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:03.986544 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 01:01:03.986618 26003 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260811 01:01:03.986699 24764 leader_election.cc:334] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 515d747c628940349bea50bbfcd1e591 (127.13.30.190:45431): Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
I20260811 01:01:03.986737 24764 leader_election.cc:302] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70fe788d37cf432fa2812890a2d12953; no voters: 515d747c628940349bea50bbfcd1e591, f52531ad45d445749d6161a0a5950355
I20260811 01:01:03.986812 26004 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 01:01:04.477502 26021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:04.477177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.131:51081)
0811 01:01:04.477371 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:04.477417 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":69,"threads_started":1}
I20260811 01:01:04.477530 26023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:04.477177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.130:41311)
0811 01:01:04.477378 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:04.477428 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":74,"threads_started":1}
I20260811 01:01:04.477677 26024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:04.477476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.129:51921)
0811 01:01:04.477603 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:04.477635 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":67,"threads_started":1}
I20260811 01:01:05.478487 26028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.478269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.129:46965)
0811 01:01:05.478380 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.478422 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":73,"threads_started":1}
I20260811 01:01:05.478536 26025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.478052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.131:60363)
0811 01:01:05.478362 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.478478 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":77,"threads_started":1}
I20260811 01:01:05.478693 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.478211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.130:49361)
0811 01:01:05.478580 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.478647 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":66,"threads_started":1}
I20260811 01:01:05.689374 26029 raft_consensus.cc:482] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:01:05.689579 26029 raft_consensus.cc:504] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } }
I20260811 01:01:05.689839 26029 leader_election.cc:288] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 515d747c628940349bea50bbfcd1e591 (127.13.30.190:45431), 70fe788d37cf432fa2812890a2d12953 (127.13.30.189:37329)
I20260811 01:01:05.690271 26030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.690052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:34560)
0811 01:01:05.690176 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.690214 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":59,"threads_started":1}
I20260811 01:01:05.690234 24808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f52531ad45d445749d6161a0a5950355" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "70fe788d37cf432fa2812890a2d12953" is_pre_election: true
I20260811 01:01:05.690369 24808 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f52531ad45d445749d6161a0a5950355 in term 2.
I20260811 01:01:05.690570 25077 leader_election.cc:302] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70fe788d37cf432fa2812890a2d12953, f52531ad45d445749d6161a0a5950355; no voters:
I20260811 01:01:05.690713 26029 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 01:01:05.690766 26030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.690642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:34568)
0811 01:01:05.690694 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.690719 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 01:01:05.690863 25076 leader_election.cc:334] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 515d747c628940349bea50bbfcd1e591 (127.13.30.190:45431): Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
I20260811 01:01:05.690768 26029 raft_consensus.cc:482] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:01:05.690927 26029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 2 FOLLOWER]: Advancing to term 3
I20260811 01:01:05.691738 26029 raft_consensus.cc:504] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } }
I20260811 01:01:05.691910 26029 leader_election.cc:288] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [CANDIDATE]: Term 3 election: Requested vote from peers 515d747c628940349bea50bbfcd1e591 (127.13.30.190:45431), 70fe788d37cf432fa2812890a2d12953 (127.13.30.189:37329)
I20260811 01:01:05.692138 26030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.692027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:34580)
0811 01:01:05.692069 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.692106 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 01:01:05.692130 24808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f52531ad45d445749d6161a0a5950355" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "70fe788d37cf432fa2812890a2d12953"
I20260811 01:01:05.692215 24808 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 2 FOLLOWER]: Advancing to term 3
I20260811 01:01:05.692494 26030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.692403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:34592)
0811 01:01:05.692448 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.692473 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260811 01:01:05.692564 25076 leader_election.cc:334] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 515d747c628940349bea50bbfcd1e591 (127.13.30.190:45431): Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
I20260811 01:01:05.692999 24808 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f52531ad45d445749d6161a0a5950355 in term 3.
I20260811 01:01:05.693197 25077 leader_election.cc:302] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70fe788d37cf432fa2812890a2d12953, f52531ad45d445749d6161a0a5950355; no voters: 515d747c628940349bea50bbfcd1e591
I20260811 01:01:05.693327 26029 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 01:01:05.693521 26029 raft_consensus.cc:686] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [term 3 LEADER]: Becoming Leader. State: Replica: f52531ad45d445749d6161a0a5950355, State: Running, Role: LEADER
I20260811 01:01:05.693619 26029 consensus_queue.cc:237] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } }
I20260811 01:01:05.694029 26038 sys_catalog.cc:455] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f52531ad45d445749d6161a0a5950355. Latest consensus state: current_term: 3 leader_uuid: "f52531ad45d445749d6161a0a5950355" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } } }
I20260811 01:01:05.694140 26038 sys_catalog.cc:458] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:05.694361 26042 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:01:05.694916 26042 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:01:05.695003 26042 catalog_manager.cc:1259] Loaded cluster ID: aaf8e0969b664caf9eb6b9ac9ddd232b
I20260811 01:01:05.695035 26042 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:01:05.695210 26042 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:01:05.695297 26042 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: Loaded TSK: 0
I20260811 01:01:05.695439 26042 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:01:05.769491 25102 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44198:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:01:05.771325 25102 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:01:05.772799 26030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.772648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:34610)
0811 01:01:05.772713 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.772764 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 01:01:05.772840 24808 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [term 3 FOLLOWER]: Refusing update from remote peer f52531ad45d445749d6161a0a5950355: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 01:01:05.773223 26030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.773118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.0.0.1:34622)
0811 01:01:05.773168 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.773194 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 01:01:05.773248 26038 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260811 01:01:05.773459 25076 consensus_peers.cc:487] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 -> Peer 515d747c628940349bea50bbfcd1e591 (127.13.30.190:45431): Couldn't send request to peer 515d747c628940349bea50bbfcd1e591. Status: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 01:01:05.774112 26048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f52531ad45d445749d6161a0a5950355. Latest consensus state: current_term: 3 leader_uuid: "f52531ad45d445749d6161a0a5950355" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } } }
I20260811 01:01:05.774284 26048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:01:05.774756 26029 sys_catalog.cc:455] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "f52531ad45d445749d6161a0a5950355" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } } }
I20260811 01:01:05.774848 26029 sys_catalog.cc:458] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:05.774832 26049 mvcc.cc:205] Tried to move back new op lower bound from 7317135629402296320 to 7317135629081649152. Current Snapshot: MvccSnapshot[applied={T|T < 7317135629402296320}]
I20260811 01:01:05.774924 26048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "f52531ad45d445749d6161a0a5950355" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "515d747c628940349bea50bbfcd1e591" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45431 } } peers { permanent_uuid: "70fe788d37cf432fa2812890a2d12953" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37329 } attrs { promote: false } } peers { permanent_uuid: "f52531ad45d445749d6161a0a5950355" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 33705 } attrs { promote: false } } }
I20260811 01:01:05.774992 26048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70fe788d37cf432fa2812890a2d12953 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:01:05.780674 26061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.777229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53384 (local address 127.13.30.130:39751)
0811 01:01:05.777349 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:05.777351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:05.777361 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:01:05.777388 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:05.777389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:05.777399 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:05.777511 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:05.777656 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:05.778428 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:05.779648 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:05.780323 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:05.780392 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:05.780405 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:05.780546 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 01:01:05.780599 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":54,"threads_started":1}
I20260811 01:01:05.780707 26055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.777012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:36911 (local address 127.0.0.1:56086)
0811 01:01:05.777332 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.777340 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:05.777378 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:05.777717 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:05.777718 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:05.777719 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:05.777764 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:05.777765 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:05.778615 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:05.778616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:05.779589 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:05.779592 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:05.780448 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:05.780449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:05.780525 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:05.780527 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 01:01:05.780570 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 01:01:05.780618 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":1,"thread_start_us":75,"threads_started":1}
I20260811 01:01:05.780793 26056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.777014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50740 (local address 127.13.30.131:41971)
0811 01:01:05.777399 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:05.777401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:05.777409 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:01:05.777434 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:05.777435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:05.777469 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:05.777656 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:05.777696 (+ 40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:05.778248 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:05.779887 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:05.780393 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:05.780462 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:05.780475 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:05.780657 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 01:01:05.780714 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":76,"threads_started":1}
I20260811 01:01:05.780929 26060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.777187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56086 (local address 127.13.30.129:36911)
0811 01:01:05.777594 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:05.777596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:05.777604 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:01:05.777629 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:05.777630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:05.777640 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:05.777701 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:05.777832 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:05.778541 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:05.779686 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:05.780340 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:05.780392 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:05.780405 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:05.780812 (+ 407us) server_negotiation.cc:299] Negotiation successful
0811 01:01:05.780862 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":56,"threads_started":1}
I20260811 01:01:05.780949 26030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.776913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:39751 (local address 127.0.0.1:53384)
0811 01:01:05.777077 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.777089 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:05.777143 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:05.777516 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:05.777517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:05.777518 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:05.777576 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:05.777578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:05.778508 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:05.778509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:05.779562 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:05.779564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:05.780418 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:05.780419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:05.780484 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:05.780488 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:01:05.780533 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 01:01:05.780581 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
I20260811 01:01:05.781105 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.776953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:41971 (local address 127.0.0.1:50740)
0811 01:01:05.777221 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.777230 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:05.777272 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:05.777559 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:05.777560 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:05.777562 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:05.777611 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:05.777612 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:05.778343 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:05.778344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:05.779808 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:05.779810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:05.780456 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:05.780457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:05.780518 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:05.780522 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:01:05.780570 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 01:01:05.780618 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":82,"threads_started":1}
I20260811 01:01:05.781144 25302 tablet_service.cc:1467] Processing CreateTablet for tablet b3cdc232be45416287fa416796a78aa6 (DEFAULT_TABLE table=test-table [id=34bfb75c497343209e3f2d6a104b2f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:05.781294 25302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3cdc232be45416287fa416796a78aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:05.781606 25763 tablet_service.cc:1467] Processing CreateTablet for tablet b3cdc232be45416287fa416796a78aa6 (DEFAULT_TABLE table=test-table [id=34bfb75c497343209e3f2d6a104b2f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:05.781737 25763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3cdc232be45416287fa416796a78aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:05.782912 26063 tablet_bootstrap.cc:492] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946: Bootstrap starting.
I20260811 01:01:05.783275 26064 tablet_bootstrap.cc:492] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89: Bootstrap starting.
I20260811 01:01:05.783388 26063 tablet_bootstrap.cc:654] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:05.783449 25544 tablet_service.cc:1467] Processing CreateTablet for tablet b3cdc232be45416287fa416796a78aa6 (DEFAULT_TABLE table=test-table [id=34bfb75c497343209e3f2d6a104b2f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:05.783586 25544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3cdc232be45416287fa416796a78aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:05.783749 26064 tablet_bootstrap.cc:654] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:05.784312 26063 tablet_bootstrap.cc:492] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946: No bootstrap required, opened a new log
I20260811 01:01:05.784309 26064 tablet_bootstrap.cc:492] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89: No bootstrap required, opened a new log
I20260811 01:01:05.784371 26064 ts_tablet_manager.cc:1397] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:05.784387 26063 ts_tablet_manager.cc:1397] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:05.784505 26064 raft_consensus.cc:348] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } }
I20260811 01:01:05.784576 26064 raft_consensus.cc:374] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:05.784541 26063 raft_consensus.cc:348] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } }
I20260811 01:01:05.784595 26064 raft_consensus.cc:729] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1367cabba94f7cbea786674b63dc89, State: Initialized, Role: FOLLOWER
I20260811 01:01:05.784601 26063 raft_consensus.cc:374] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:05.784621 26063 raft_consensus.cc:729] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3277febdecd149e0bd31853aefb16946, State: Initialized, Role: FOLLOWER
I20260811 01:01:05.784646 26064 consensus_queue.cc:260] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } }
I20260811 01:01:05.784684 26063 consensus_queue.cc:260] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } }
I20260811 01:01:05.784833 26064 ts_tablet_manager.cc:1428] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:05.784861 26063 ts_tablet_manager.cc:1428] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:05.785339 26025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.785148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.131:49173)
0811 01:01:05.785275 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.785309 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260811 01:01:05.785424 26077 tablet_bootstrap.cc:492] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c: Bootstrap starting.
I20260811 01:01:05.785601 26028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.785511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.129:47635)
0811 01:01:05.785545 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.785572 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 01:01:05.785914 26077 tablet_bootstrap.cc:654] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:05.786442 25414 heartbeater.cc:503] Master 127.13.30.188:33705 was elected leader, sending a full tablet report...
I20260811 01:01:05.786465 26077 tablet_bootstrap.cc:492] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c: No bootstrap required, opened a new log
I20260811 01:01:05.786513 26077 ts_tablet_manager.cc:1397] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 01:01:05.786711 26077 raft_consensus.cc:348] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } }
I20260811 01:01:05.786777 26077 raft_consensus.cc:374] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:05.786789 26077 raft_consensus.cc:729] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c1862260007427eb9f43a6f7309b47c, State: Initialized, Role: FOLLOWER
I20260811 01:01:05.786823 26077 consensus_queue.cc:260] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } }
I20260811 01:01:05.787015 26077 ts_tablet_manager.cc:1428] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:05.787328 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.787180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.130:35595)
0811 01:01:05.787270 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.787300 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 01:01:05.787480 25646 heartbeater.cc:503] Master 127.13.30.188:33705 was elected leader, sending a full tablet report...
I20260811 01:01:05.787642 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.787513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.130:45657)
0811 01:01:05.787589 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.787616 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 01:01:05.857524 26072 raft_consensus.cc:482] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:01:05.857645 26072 raft_consensus.cc:504] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } }
I20260811 01:01:05.857792 26072 leader_election.cc:288] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c1862260007427eb9f43a6f7309b47c (127.13.30.130:39751), 3277febdecd149e0bd31853aefb16946 (127.13.30.129:36911)
I20260811 01:01:05.858054 25573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3cdc232be45416287fa416796a78aa6" candidate_uuid: "cc1367cabba94f7cbea786674b63dc89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c1862260007427eb9f43a6f7309b47c" is_pre_election: true
I20260811 01:01:05.858098 25339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3cdc232be45416287fa416796a78aa6" candidate_uuid: "cc1367cabba94f7cbea786674b63dc89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3277febdecd149e0bd31853aefb16946" is_pre_election: true
I20260811 01:01:05.858156 25573 raft_consensus.cc:2454] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1367cabba94f7cbea786674b63dc89 in term 0.
I20260811 01:01:05.858179 25339 raft_consensus.cc:2454] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc1367cabba94f7cbea786674b63dc89 in term 0.
I20260811 01:01:05.858343 25681 leader_election.cc:302] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3277febdecd149e0bd31853aefb16946, cc1367cabba94f7cbea786674b63dc89; no voters:
I20260811 01:01:05.858474 26072 raft_consensus.cc:2781] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:01:05.858522 26072 raft_consensus.cc:482] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:01:05.858542 26072 raft_consensus.cc:3037] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:05.859328 26072 raft_consensus.cc:504] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } }
I20260811 01:01:05.859464 26072 leader_election.cc:288] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [CANDIDATE]: Term 1 election: Requested vote from peers 0c1862260007427eb9f43a6f7309b47c (127.13.30.130:39751), 3277febdecd149e0bd31853aefb16946 (127.13.30.129:36911)
I20260811 01:01:05.859701 25339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3cdc232be45416287fa416796a78aa6" candidate_uuid: "cc1367cabba94f7cbea786674b63dc89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3277febdecd149e0bd31853aefb16946"
I20260811 01:01:05.859694 25573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3cdc232be45416287fa416796a78aa6" candidate_uuid: "cc1367cabba94f7cbea786674b63dc89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c1862260007427eb9f43a6f7309b47c"
I20260811 01:01:05.859781 25339 raft_consensus.cc:3037] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:05.859782 25573 raft_consensus.cc:3037] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:05.860445 25339 raft_consensus.cc:2454] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1367cabba94f7cbea786674b63dc89 in term 1.
I20260811 01:01:05.860648 25681 leader_election.cc:302] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3277febdecd149e0bd31853aefb16946, cc1367cabba94f7cbea786674b63dc89; no voters:
I20260811 01:01:05.860667 25573 raft_consensus.cc:2454] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc1367cabba94f7cbea786674b63dc89 in term 1.
I20260811 01:01:05.860808 26072 raft_consensus.cc:2781] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:01:05.861038 26072 raft_consensus.cc:686] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [term 1 LEADER]: Becoming Leader. State: Replica: cc1367cabba94f7cbea786674b63dc89, State: Running, Role: LEADER
I20260811 01:01:05.861125 25882 heartbeater.cc:503] Master 127.13.30.188:33705 was elected leader, sending a full tablet report...
I20260811 01:01:05.861104 26072 consensus_queue.cc:237] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } } peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } }
I20260811 01:01:05.861577 26025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.861383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.131:45751)
0811 01:01:05.861496 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.861542 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 01:01:05.862073 25102 catalog_manager.cc:5495] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc1367cabba94f7cbea786674b63dc89 (127.13.30.131). New cstate: current_term: 1 leader_uuid: "cc1367cabba94f7cbea786674b63dc89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc1367cabba94f7cbea786674b63dc89" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41971 } health_report { overall_health: HEALTHY } } }
I20260811 01:01:05.874240 26056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.871990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50756 (local address 127.13.30.131:41971)
0811 01:01:05.872034 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:05.872036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:05.872045 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:05.872123 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:05.872124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:05.872134 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:05.872179 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:01:05.872309 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:05.872800 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:05.873597 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:05.873797 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:05.873853 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:05.874001 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:01:05.874033 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:01:05.874074 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:05.874129 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 01:01:05.874155 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 01:01:05.875347 25573 raft_consensus.cc:1261] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c [term 1 FOLLOWER]: Refusing update from remote peer cc1367cabba94f7cbea786674b63dc89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:05.875347 25339 raft_consensus.cc:1261] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946 [term 1 FOLLOWER]: Refusing update from remote peer cc1367cabba94f7cbea786674b63dc89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:05.875679 26072 consensus_queue.cc:1035] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c1862260007427eb9f43a6f7309b47c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:05.875835 26081 consensus_queue.cc:1035] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3277febdecd149e0bd31853aefb16946" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 36911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:05.876478 26028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.876374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.129:60367)
0811 01:01:05.876410 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.876445 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 01:01:05.876644 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.876481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.130:46405)
0811 01:01:05.876577 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.876610 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 01:01:05.878111 26025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.877874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.131:45547)
0811 01:01:05.878043 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.878077 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
I20260811 01:01:05.878386 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.878282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.130:41625)
0811 01:01:05.878326 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.878357 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 01:01:05.878507 26028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.877994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.129:42403)
0811 01:01:05.878443 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.878477 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432}
I20260811 01:01:05.879179 26025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.879074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45431 (local address 127.13.30.131:39981)
0811 01:01:05.879123 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.879149 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:45431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 01:01:05.879905 25102 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44198:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:01:05.880012 25102 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44198:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:01:05.881310 25102 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f52531ad45d445749d6161a0a5950355: Sending DeleteTablet for 3 replicas of tablet b3cdc232be45416287fa416796a78aa6
I20260811 01:01:05.881683 25544 tablet_service.cc:1514] Processing DeleteTablet for tablet b3cdc232be45416287fa416796a78aa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:05 UTC) from {username='oryx', principal='oryx/127.13.30.188@KRBTEST.COM'} at 127.0.0.1:53384
I20260811 01:01:05.881705 25302 tablet_service.cc:1514] Processing DeleteTablet for tablet b3cdc232be45416287fa416796a78aa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:05 UTC) from {username='oryx', principal='oryx/127.13.30.188@KRBTEST.COM'} at 127.0.0.1:56086
I20260811 01:01:05.882011 25763 tablet_service.cc:1514] Processing DeleteTablet for tablet b3cdc232be45416287fa416796a78aa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:05 UTC) from {username='oryx', principal='oryx/127.13.30.188@KRBTEST.COM'} at 127.0.0.1:50740
I20260811 01:01:05.882045 26108 tablet_replica.cc:330] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946: stopping tablet replica
I20260811 01:01:05.882104 26108 raft_consensus.cc:2229] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:05.882153 26108 raft_consensus.cc:2258] T b3cdc232be45416287fa416796a78aa6 P 3277febdecd149e0bd31853aefb16946 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:05.882161 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 25038
I20260811 01:01:05.899267 26107 tablet_replica.cc:330] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c: stopping tablet replica
I20260811 01:01:05.899426 26107 raft_consensus.cc:2229] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:05.899500 26107 raft_consensus.cc:2258] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:05.907711 26107 ts_tablet_manager.cc:1905] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:05.909988 26107 ts_tablet_manager.cc:1918] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:01:05.910104 26107 log.cc:1196] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/b3cdc232be45416287fa416796a78aa6
I20260811 01:01:05.910399 26107 ts_tablet_manager.cc:1939] T b3cdc232be45416287fa416796a78aa6 P 0c1862260007427eb9f43a6f7309b47c: Deleting consensus metadata
I20260811 01:01:05.913239 25077 catalog_manager.cc:4841] TS 0c1862260007427eb9f43a6f7309b47c (127.13.30.130:39751): tablet b3cdc232be45416287fa416796a78aa6 (table test-table [id=34bfb75c497343209e3f2d6a104b2f55]) successfully deleted
I20260811 01:01:05.915195 26109 tablet_replica.cc:330] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89: stopping tablet replica
I20260811 01:01:05.915290 26109 raft_consensus.cc:2229] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:01:05.915376 26109 raft_consensus.cc:2258] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:05.915820 26109 ts_tablet_manager.cc:1905] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:05.917744 26109 ts_tablet_manager.cc:1918] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:01:05.917840 26109 log.cc:1196] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/b3cdc232be45416287fa416796a78aa6
I20260811 01:01:05.918097 26109 ts_tablet_manager.cc:1939] T b3cdc232be45416287fa416796a78aa6 P cc1367cabba94f7cbea786674b63dc89: Deleting consensus metadata
I20260811 01:01:05.918608 25076 catalog_manager.cc:4841] TS cc1367cabba94f7cbea786674b63dc89 (127.13.30.131:41971): tablet b3cdc232be45416287fa416796a78aa6 (table test-table [id=34bfb75c497343209e3f2d6a104b2f55]) successfully deleted
I20260811 01:01:05.920922 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 25433
I20260811 01:01:05.921028 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:05.920888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:36911 (local address 127.0.0.1:56090)
0811 01:01:05.920950 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:05.920988 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:36911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 01:01:05.926057 25077 catalog_manager.cc:4584] TS 3277febdecd149e0bd31853aefb16946 (127.13.30.129:36911): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b3cdc232be45416287fa416796a78aa6: Network error: Client connection negotiation failed: client connection to 127.13.30.129:36911: connect: Connection refused (error 111)
I20260811 01:01:05.937690 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 25657
I20260811 01:01:05.951890 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 24539
I20260811 01:01:05.971413 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 24886
2026-08-11T01:01:05Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6879 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:01:06 dist-test-slave-42z9 krb5kdc[26112](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:01:06 dist-test-slave-42z9 krb5kdc[26112](info): set up 2 sockets
Aug 11 01:01:06 dist-test-slave-42z9 krb5kdc[26112](info): commencing operation
krb5kdc: starting...
W20260811 01:01:07.166236 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:01:07 dist-test-slave-42z9 krb5kdc[26112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410067, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:01:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:01:07Z Disabled control of system clock
WARNING: no policy specified for oryx/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.190.keytab.
Entry for principal oryx/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.190.keytab.
I20260811 01:01:07.293602 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:43903
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.190.keytab
--principal=oryx/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:43903
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:07.377537 26137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:07.377759 26137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:07.377790 26137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:07.379025 26137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:01:07.379076 26137 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 01:01:07.379092 26137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:07.379109 26137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:07.379124 26137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:01:07.379142 26137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:01:07.380848 26137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:43903
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.190.keytab
--principal=oryx/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:43903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:07.381136 26137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:07.381373 26137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:07.386389 26144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:07.386590 26137 server_base.cc:1034] running on GCE node
W20260811 01:01:07.386417 26148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:07.386417 26145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:07.386983 26137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:07.387312 26137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:07.388477 26137 hybrid_clock.cc:648] HybridClock initialized: now 1786410067388459 us; error 31 us; skew 500 ppm
Aug 11 01:01:07 dist-test-slave-42z9 krb5kdc[26112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410067, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:07.391599 26137 init.cc:377] Logged in from keytab as oryx/127.13.30.190@KRBTEST.COM (short username oryx)
I20260811 01:01:07.392081 26137 webserver.cc:460] Webserver started at http://127.13.30.190:42395/ using document root <none> and password file <none>
I20260811 01:01:07.392324 26137 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:07.392375 26137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:07.392508 26137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:07.393652 26137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "4e7883a42f704af399b242469fa0a81d"
format_stamp: "Formatted at 2026-08-11 01:01:07 on dist-test-slave-42z9"
server_key: "63ee817950d12e292a4cee2bc40d7d8f"
server_key_iv: "dca505ae4dc593b7ffc0f9f2ca102d0f"
server_key_version: "encryptionkey@0"
I20260811 01:01:07.393996 26137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "4e7883a42f704af399b242469fa0a81d"
format_stamp: "Formatted at 2026-08-11 01:01:07 on dist-test-slave-42z9"
server_key: "63ee817950d12e292a4cee2bc40d7d8f"
server_key_iv: "dca505ae4dc593b7ffc0f9f2ca102d0f"
server_key_version: "encryptionkey@0"
I20260811 01:01:07.395416 26137 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:01:07.396165 26159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:07.396347 26137 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:07.396437 26137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "4e7883a42f704af399b242469fa0a81d"
format_stamp: "Formatted at 2026-08-11 01:01:07 on dist-test-slave-42z9"
server_key: "63ee817950d12e292a4cee2bc40d7d8f"
server_key_iv: "dca505ae4dc593b7ffc0f9f2ca102d0f"
server_key_version: "encryptionkey@0"
I20260811 01:01:07.396507 26137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:07.407804 26137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:07.410043 26137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:07.410182 26137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:07.414840 26137 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:43903
I20260811 01:01:07.414924 26262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:43903 every 8 connection(s)
I20260811 01:01:07.415228 26137 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:01:07.415972 26263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:07.418366 26263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d: Bootstrap starting.
I20260811 01:01:07.418967 26263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:07.419236 26263 log.cc:824] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:07.419747 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 26137
I20260811 01:01:07.419868 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:01:07.420066 13434 external_mini_cluster.cc:1428] Setting key 49c4ab537afb04030066c401ee2757a5
I20260811 01:01:07.420095 26263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d: No bootstrap required, opened a new log
I20260811 01:01:07.422847 26263 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e7883a42f704af399b242469fa0a81d" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 43903 } }
I20260811 01:01:07.422991 26263 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:07.423013 26263 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7883a42f704af399b242469fa0a81d, State: Initialized, Role: FOLLOWER
I20260811 01:01:07.423125 26263 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e7883a42f704af399b242469fa0a81d" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 43903 } }
I20260811 01:01:07.423195 26263 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:01:07.423229 26263 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:01:07.423274 26263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:07.424011 26263 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e7883a42f704af399b242469fa0a81d" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 43903 } }
I20260811 01:01:07.424124 26263 leader_election.cc:302] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e7883a42f704af399b242469fa0a81d; no voters:
I20260811 01:01:07.424278 26263 leader_election.cc:288] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:01:07.424376 26274 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:01:07.424546 26274 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [term 1 LEADER]: Becoming Leader. State: Replica: 4e7883a42f704af399b242469fa0a81d, State: Running, Role: LEADER
I20260811 01:01:07.424599 26263 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:01:07.424680 26274 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e7883a42f704af399b242469fa0a81d" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 43903 } }
I20260811 01:01:07.425065 26275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e7883a42f704af399b242469fa0a81d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e7883a42f704af399b242469fa0a81d" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 43903 } } }
I20260811 01:01:07.425144 26275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:07.425403 26276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e7883a42f704af399b242469fa0a81d. Latest consensus state: current_term: 1 leader_uuid: "4e7883a42f704af399b242469fa0a81d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e7883a42f704af399b242469fa0a81d" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 43903 } } }
I20260811 01:01:07.425822 26291 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:01:07.425881 26276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:07.426440 26291 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 01:01:07 dist-test-slave-42z9 krb5kdc[26112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410067, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:07.428072 26291 catalog_manager.cc:1347] Generated new cluster ID: 510c8c6f8dd84bc989ab10f6d8d513d1
I20260811 01:01:07.428154 26291 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:01:07.431362 26271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:07.420607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44868 (local address 127.13.30.190:43903)
0811 01:01:07.420802 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:07.420811 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:07.420849 (+ 38us) server_negotiation.cc:407] Connection header received
0811 01:01:07.421412 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:07.421420 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:07.421509 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:07.421627 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:07.422410 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.423451 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.424449 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.425082 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.425196 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:07.428137 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:07.428142 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:07.428143 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:07.428157 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:07.429757 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:07.430098 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:07.430101 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:07.430101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:07.430188 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:07.430371 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:07.430372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:07.430372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:07.430613 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:07.430773 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:07.430853 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 01:01:07.430991 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":87,"threads_started":1}
I20260811 01:01:07.436486 26291 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:01:07.437012 26291 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:01:07.444470 26291 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d: Generated new TSK 0
I20260811 01:01:07.444674 26291 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.129.keytab.
Entry for principal oryx/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.129.keytab.
I20260811 01:01:07.477053 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:43903
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.129.keytab
--principal=oryx/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:07.585232 26314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:07.585495 26314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:07.585529 26314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:07.586758 26314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:07.586804 26314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:07.586824 26314 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:01:07.586843 26314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:01:07.588457 26314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.129.keytab
--principal=oryx/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.30.190:43903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:07.588675 26314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:07.588884 26314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:07.593918 26330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:07.593950 26332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:07.593959 26329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:07.594250 26314 server_base.cc:1034] running on GCE node
I20260811 01:01:07.594463 26314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:07.594691 26314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:07.595834 26314 hybrid_clock.cc:648] HybridClock initialized: now 1786410067595817 us; error 30 us; skew 500 ppm
Aug 11 01:01:07 dist-test-slave-42z9 krb5kdc[26112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410067, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:07.598323 26314 init.cc:377] Logged in from keytab as oryx/127.13.30.129@KRBTEST.COM (short username oryx)
I20260811 01:01:07.598763 26314 webserver.cc:460] Webserver started at http://127.13.30.129:41383/ using document root <none> and password file <none>
I20260811 01:01:07.598997 26314 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:07.599038 26314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:07.599129 26314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:07.600229 26314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "00e44b32235440a3ba881eb58c78d3f6"
format_stamp: "Formatted at 2026-08-11 01:01:07 on dist-test-slave-42z9"
server_key: "775622cf35f985f9b92d9755d3ff5d9d"
server_key_iv: "b2c24989c5901fd1e0636ec44ce6362a"
server_key_version: "encryptionkey@0"
I20260811 01:01:07.600632 26314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "00e44b32235440a3ba881eb58c78d3f6"
format_stamp: "Formatted at 2026-08-11 01:01:07 on dist-test-slave-42z9"
server_key: "775622cf35f985f9b92d9755d3ff5d9d"
server_key_iv: "b2c24989c5901fd1e0636ec44ce6362a"
server_key_version: "encryptionkey@0"
I20260811 01:01:07.601953 26314 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:01:07.602599 26343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:07.602748 26314 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 01:01:07.602836 26314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "00e44b32235440a3ba881eb58c78d3f6"
format_stamp: "Formatted at 2026-08-11 01:01:07 on dist-test-slave-42z9"
server_key: "775622cf35f985f9b92d9755d3ff5d9d"
server_key_iv: "b2c24989c5901fd1e0636ec44ce6362a"
server_key_version: "encryptionkey@0"
I20260811 01:01:07.602900 26314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:07.619004 26314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:07.621006 26314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:07.621167 26314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:07.621784 26314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:07.621831 26314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:07.621865 26314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:07.621881 26314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:07.628816 26314 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:40001
I20260811 01:01:07.628916 26530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:40001 every 8 connection(s)
I20260811 01:01:07.629237 26314 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
Aug 11 01:01:07 dist-test-slave-42z9 krb5kdc[26112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410067, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:07.632313 26271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:07.622293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:48617 (local address 127.13.30.190:43903)
0811 01:01:07.622362 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:07.622365 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:07.622569 (+ 204us) server_negotiation.cc:407] Connection header received
0811 01:01:07.623089 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:07.623091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:07.623105 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:07.623190 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:07.624098 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.624917 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.626514 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.626822 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.626914 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:07.629959 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:07.629961 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:07.629961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:07.629969 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:07.631095 (+ 1126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:07.631538 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:07.631539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:07.631539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:07.631592 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:07.631783 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:07.631784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:07.631784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:07.631891 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:07.631937 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:07.632162 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 01:01:07.632242 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 01:01:07.632534 26356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:07.622248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:43903 (local address 127.13.30.129:48617)
0811 01:01:07.622438 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:07.622482 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:07.622991 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:07.623252 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:07.623257 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:07.623651 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:07.623981 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:07.623989 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.625061 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.625062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:07.626390 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:07.626395 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.627080 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.627082 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:07.627459 (+ 377us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:07.628207 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:07.628218 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:07.629850 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:07.631193 (+ 1343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:07.631201 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:07.631203 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:07.631468 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:07.631644 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:07.631645 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:07.631645 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:07.631740 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:07.631933 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:07.631936 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:07.632063 (+ 127us) client_negotiation.cc:769] Sending connection context
0811 01:01:07.632144 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 01:01:07.632285 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":100,"threads_started":1}
I20260811 01:01:07.633020 26532 heartbeater.cc:347] Connected to a master server at 127.13.30.190:43903
I20260811 01:01:07.633111 26532 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:07.633296 26532 heartbeater.cc:511] Master 127.13.30.190:43903 requested a full tablet report, sending...
I20260811 01:01:07.633876 26179 ts_manager.cc:194] Registered new tserver with Master: 00e44b32235440a3ba881eb58c78d3f6 (127.13.30.129:40001)
I20260811 01:01:07.634783 26179 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:48617
I20260811 01:01:07.634917 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 26314
I20260811 01:01:07.635036 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:01:07.635255 13434 external_mini_cluster.cc:1428] Setting key 5d7c08e51fd3afd39307bd7ff9d577b7
I20260811 01:01:07.640089 26271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:07.634142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:42491 (local address 127.13.30.190:43903)
0811 01:01:07.634185 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:07.634187 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:07.634315 (+ 128us) server_negotiation.cc:407] Connection header received
0811 01:01:07.634374 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:07.634375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:07.634384 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:07.634425 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:07.634782 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.635487 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.636339 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.636532 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.636581 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:07.637635 (+ 1054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:07.637637 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:07.637637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:07.637643 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:07.639057 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:07.639383 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:07.639384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:07.639384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:07.639438 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:07.639643 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:07.639643 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:07.639643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:07.639746 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:07.639795 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:07.639948 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 01:01:07.640018 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 01:01:07.640149 26544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:07.634069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:43903 (local address 127.13.30.129:42491)
0811 01:01:07.634246 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:07.634258 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:07.634320 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:07.634439 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:07.634439 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:07.634638 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:07.634715 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:07.634717 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.635586 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.635587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:07.636243 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:07.636246 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.636594 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.636595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:07.636657 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:07.637097 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:07.637103 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:07.637563 (+ 460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:07.639135 (+ 1572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:07.639136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:07.639137 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:07.639321 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:07.639511 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:07.639512 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:07.639512 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:07.639582 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:07.639800 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:07.639800 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:07.639853 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 01:01:07.639930 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 01:01:07.640046 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":73,"threads_started":1}
WARNING: no policy specified for oryx/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.130.keytab.
Entry for principal oryx/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.130.keytab.
I20260811 01:01:07.664191 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:43903
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.130.keytab
--principal=oryx/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:07.748211 26550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:07.748413 26550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:07.748437 26550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:07.749583 26550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:07.749617 26550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:07.749636 26550 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:01:07.749651 26550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:01:07.751160 26550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.130.keytab
--principal=oryx/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.30.190:43903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:07.751374 26550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:07.751582 26550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:07.756527 26561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:07.756606 26558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:07.756739 26565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:07.756717 26550 server_base.cc:1034] running on GCE node
I20260811 01:01:07.756984 26550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:07.757213 26550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:07.758383 26550 hybrid_clock.cc:648] HybridClock initialized: now 1786410067758363 us; error 27 us; skew 500 ppm
Aug 11 01:01:07 dist-test-slave-42z9 krb5kdc[26112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410067, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:07.761013 26550 init.cc:377] Logged in from keytab as oryx/127.13.30.130@KRBTEST.COM (short username oryx)
I20260811 01:01:07.761520 26550 webserver.cc:460] Webserver started at http://127.13.30.130:38939/ using document root <none> and password file <none>
I20260811 01:01:07.761758 26550 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:07.761821 26550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:07.761956 26550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:07.763051 26550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "0365003bfb674fda8a3fd4f5ff14bf03"
format_stamp: "Formatted at 2026-08-11 01:01:07 on dist-test-slave-42z9"
server_key: "56cafa74d6107ae219a68d607e0f953c"
server_key_iv: "1f0cb5938f08b8e20fc7b23c8fb1d4ba"
server_key_version: "encryptionkey@0"
I20260811 01:01:07.763386 26550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "0365003bfb674fda8a3fd4f5ff14bf03"
format_stamp: "Formatted at 2026-08-11 01:01:07 on dist-test-slave-42z9"
server_key: "56cafa74d6107ae219a68d607e0f953c"
server_key_iv: "1f0cb5938f08b8e20fc7b23c8fb1d4ba"
server_key_version: "encryptionkey@0"
I20260811 01:01:07.764708 26550 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:01:07.765388 26574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:07.765550 26550 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 01:01:07.765637 26550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "0365003bfb674fda8a3fd4f5ff14bf03"
format_stamp: "Formatted at 2026-08-11 01:01:07 on dist-test-slave-42z9"
server_key: "56cafa74d6107ae219a68d607e0f953c"
server_key_iv: "1f0cb5938f08b8e20fc7b23c8fb1d4ba"
server_key_version: "encryptionkey@0"
I20260811 01:01:07.765700 26550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:07.795769 26550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:07.798005 26550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:07.798159 26550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:07.798781 26550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:07.798834 26550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:07.798866 26550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:07.798898 26550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:01:07 dist-test-slave-42z9 krb5kdc[26112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410067, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:07.806022 26550 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:37543
I20260811 01:01:07.806094 26770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:37543 every 8 connection(s)
I20260811 01:01:07.806468 26550 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:01:07.809289 26271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:07.799196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:41239 (local address 127.13.30.190:43903)
0811 01:01:07.799259 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:07.799262 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:07.799516 (+ 254us) server_negotiation.cc:407] Connection header received
0811 01:01:07.800089 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:07.800091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:07.800104 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:07.800203 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:07.801112 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.801933 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.803066 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.803385 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.803475 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:07.806371 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:07.806373 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:07.806373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:07.806382 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:07.807894 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:07.808313 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:07.808314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:07.808315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:07.808379 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:07.808628 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:07.808629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:07.808629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:07.808757 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:07.808825 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:07.809100 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 01:01:07.809191 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 01:01:07.809510 26588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:07.799191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:43903 (local address 127.13.30.130:41239)
0811 01:01:07.799385 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:07.799430 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:07.799965 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:07.800297 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:07.800300 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:07.800675 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:07.800995 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:07.801003 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.802040 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.802041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:07.802984 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:07.802989 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.803500 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.803501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:07.803673 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:07.804306 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:07.804315 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:07.806253 (+ 1938us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:07.807980 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:07.807988 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:07.807991 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:07.808229 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:07.808439 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:07.808440 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:07.808440 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:07.808564 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:07.808815 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:07.808822 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:07.808972 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 01:01:07.809063 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 01:01:07.809241 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260811 01:01:07.809969 26773 heartbeater.cc:347] Connected to a master server at 127.13.30.190:43903
I20260811 01:01:07.810060 26773 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:07.810252 26773 heartbeater.cc:511] Master 127.13.30.190:43903 requested a full tablet report, sending...
I20260811 01:01:07.810491 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 26550
I20260811 01:01:07.810603 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:01:07.810671 26182 ts_manager.cc:194] Registered new tserver with Master: 0365003bfb674fda8a3fd4f5ff14bf03 (127.13.30.130:37543)
I20260811 01:01:07.810776 13434 external_mini_cluster.cc:1428] Setting key 7ce0d05efc3a50c8338ca74a5425bf16
I20260811 01:01:07.811121 26182 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:41239
I20260811 01:01:07.816488 26271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:07.811106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:46263 (local address 127.13.30.190:43903)
0811 01:01:07.811149 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:07.811151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:07.811475 (+ 324us) server_negotiation.cc:407] Connection header received
0811 01:01:07.811530 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:07.811531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:07.811541 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:07.811586 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:07.811928 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.812402 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.813074 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.813272 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.813328 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:07.814260 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:07.814262 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:07.814262 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:07.814269 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:07.815391 (+ 1122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:07.815701 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:07.815702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:07.815703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:07.815762 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:07.815928 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:07.815929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:07.815930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:07.816083 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:07.816146 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:07.816291 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 01:01:07.816383 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 01:01:07.816499 26779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:07.811278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:43903 (local address 127.13.30.130:46263)
0811 01:01:07.811416 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:07.811428 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:07.811485 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:07.811589 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:07.811590 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:07.811782 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:07.811856 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:07.811859 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.812492 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.812493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:07.812999 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:07.813000 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.813338 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.813340 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:07.813405 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:07.813893 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:07.813897 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:07.814180 (+ 283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:07.815471 (+ 1291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:07.815472 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:07.815472 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:07.815639 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:07.815816 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:07.815817 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:07.815817 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:07.815879 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:07.816148 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:07.816149 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:07.816200 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 01:01:07.816261 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 01:01:07.816383 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":80,"threads_started":1}
WARNING: no policy specified for oryx/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.131.keytab.
Entry for principal oryx/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.131.keytab.
I20260811 01:01:07.838127 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:43903
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.131.keytab
--principal=oryx/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:07.925480 26785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:07.925711 26785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:07.925740 26785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:07.926998 26785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:07.927040 26785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:07.927062 26785 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:01:07.927081 26785 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:01:07.928640 26785 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.131.keytab
--principal=oryx/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.30.190:43903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:07.928884 26785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:07.929111 26785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:07.934319 26796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:07.934309 26801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:07.934374 26785 server_base.cc:1034] running on GCE node
W20260811 01:01:07.934309 26795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:07.934742 26785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:07.934985 26785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:07.936126 26785 hybrid_clock.cc:648] HybridClock initialized: now 1786410067936116 us; error 30 us; skew 500 ppm
Aug 11 01:01:07 dist-test-slave-42z9 krb5kdc[26112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410067, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:07.938786 26785 init.cc:377] Logged in from keytab as oryx/127.13.30.131@KRBTEST.COM (short username oryx)
I20260811 01:01:07.939263 26785 webserver.cc:460] Webserver started at http://127.13.30.131:36207/ using document root <none> and password file <none>
I20260811 01:01:07.939497 26785 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:07.939551 26785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:07.939690 26785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:07.940815 26785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "c209e007665c4f81909323290762f068"
format_stamp: "Formatted at 2026-08-11 01:01:07 on dist-test-slave-42z9"
server_key: "72891ac01a34968fa5e04640b1700abd"
server_key_iv: "87c9f4fedbe325ca592cf3e09e41e71a"
server_key_version: "encryptionkey@0"
I20260811 01:01:07.941181 26785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "c209e007665c4f81909323290762f068"
format_stamp: "Formatted at 2026-08-11 01:01:07 on dist-test-slave-42z9"
server_key: "72891ac01a34968fa5e04640b1700abd"
server_key_iv: "87c9f4fedbe325ca592cf3e09e41e71a"
server_key_version: "encryptionkey@0"
I20260811 01:01:07.942607 26785 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:01:07.943323 26813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:07.943493 26785 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:07.943581 26785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "c209e007665c4f81909323290762f068"
format_stamp: "Formatted at 2026-08-11 01:01:07 on dist-test-slave-42z9"
server_key: "72891ac01a34968fa5e04640b1700abd"
server_key_iv: "87c9f4fedbe325ca592cf3e09e41e71a"
server_key_version: "encryptionkey@0"
I20260811 01:01:07.943671 26785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:07.958643 26785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:07.960904 26785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:07.961036 26785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:07.961643 26785 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:07.961688 26785 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:07.961712 26785 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:07.961724 26785 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:07.968274 26785 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:42019
I20260811 01:01:07.968338 27014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:42019 every 8 connection(s)
Aug 11 01:01:07 dist-test-slave-42z9 krb5kdc[26112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410067, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:07.968799 26785 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:01:07.972177 26271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:07.962108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:55543 (local address 127.13.30.190:43903)
0811 01:01:07.962175 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:07.962178 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:07.962379 (+ 201us) server_negotiation.cc:407] Connection header received
0811 01:01:07.962889 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:07.962890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:07.962904 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:07.962976 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:07.963781 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.964541 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.966136 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.966437 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.966519 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:07.969307 (+ 2788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:07.969309 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:07.969309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:07.969318 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:07.970838 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:07.971296 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:07.971298 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:07.971298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:07.971362 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:07.971586 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:07.971587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:07.971587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:07.971723 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:07.971787 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:07.972031 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 01:01:07.972105 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 01:01:07.972362 26825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:07.962073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:43903 (local address 127.13.30.131:55543)
0811 01:01:07.962249 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:07.962290 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:07.962785 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:07.963038 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:07.963042 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:07.963364 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:07.963665 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:07.963672 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.964645 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.964646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:07.966031 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:07.966035 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.966524 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.966525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:07.966636 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:07.967262 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:07.967273 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:07.969176 (+ 1903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:07.970949 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:07.970957 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:07.970967 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:07.971218 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:07.971421 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:07.971422 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:07.971425 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:07.971533 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:07.971778 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:07.971781 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:07.971905 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 01:01:07.971999 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 01:01:07.972138 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
I20260811 01:01:07.972859 27015 heartbeater.cc:347] Connected to a master server at 127.13.30.190:43903
I20260811 01:01:07.972954 27015 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:07.973160 27015 heartbeater.cc:511] Master 127.13.30.190:43903 requested a full tablet report, sending...
I20260811 01:01:07.973582 26182 ts_manager.cc:194] Registered new tserver with Master: c209e007665c4f81909323290762f068 (127.13.30.131:42019)
I20260811 01:01:07.974056 26182 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:55543
I20260811 01:01:07.974298 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 26785
I20260811 01:01:07.974412 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:01:07.974622 13434 external_mini_cluster.cc:1428] Setting key 58a330ea301ebca58fca6c6a9b5a2097
I20260811 01:01:07.975389 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:01:07.979705 27023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:07.973928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:43903 (local address 127.13.30.131:58417)
0811 01:01:07.974048 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:07.974059 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:07.974133 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:07.974286 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:07.974287 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:07.974498 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:07.974577 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:07.974579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.975280 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.975281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:07.976056 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:07.976059 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.976387 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.976388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:07.976452 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:07.976849 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:07.976854 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:07.977226 (+ 372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:07.978828 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:07.978829 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:07.978829 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:07.978997 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:07.979177 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:07.979177 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:07.979177 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:07.979223 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:07.979459 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:07.979459 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:07.979499 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 01:01:07.979544 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 01:01:07.979626 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":66,"threads_started":1}
I20260811 01:01:07.979734 26271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:07.973990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:58417 (local address 127.13.30.190:43903)
0811 01:01:07.974037 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:07.974039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:07.974101 (+ 62us) server_negotiation.cc:407] Connection header received
0811 01:01:07.974215 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:07.974216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:07.974226 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:07.974280 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:07.974660 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.975198 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.976135 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.976317 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.976379 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:07.977313 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:07.977315 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:07.977315 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:07.977321 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:07.978746 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:07.979063 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:07.979064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:07.979065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:07.979122 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:07.979268 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:07.979269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:07.979269 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:07.979402 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:07.979461 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:07.979580 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 01:01:07.979651 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
Aug 11 01:01:07 dist-test-slave-42z9 krb5kdc[26112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410067, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:01:07 dist-test-slave-42z9 krb5kdc[26112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:07 dist-test-slave-42z9 krb5kdc[26112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 01:01:07.999181 26271 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:07.993513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44872 (local address 127.13.30.190:43903)
0811 01:01:07.993562 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:07.993564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:07.993573 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:07.993599 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:07.993599 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:07.993609 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:07.993660 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:07.994303 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.994815 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.995583 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:07.995776 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:07.995832 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:07.998950 (+ 3118us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44872: BlockingRecv error: recv got EOF from 127.0.0.1:44872 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 11 01:01:08 dist-test-slave-42z9 krb5kdc[26112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410067, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:08.006680 26271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:07.999905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44878 (local address 127.13.30.190:43903)
0811 01:01:07.999962 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:07.999964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.000024 (+ 60us) server_negotiation.cc:407] Connection header received
0811 01:01:08.000098 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.000098 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.000108 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.000150 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:08.000660 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.001154 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.001881 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.002070 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.002123 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.004318 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:08.004320 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:08.004321 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:08.004329 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:08.005615 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:08.005926 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:08.005927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:08.005927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:08.005981 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:08.006159 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:08.006160 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:08.006161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:08.006279 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:08.006369 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.006502 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.006584 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 01:01:08.008265 26182 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:01:08.010003 26182 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:01:08.016983 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.012610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51664 (local address 127.13.30.131:42019)
0811 01:01:08.012830 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.012835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.013328 (+ 493us) server_negotiation.cc:407] Connection header received
0811 01:01:08.013374 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.013376 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.013391 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.013504 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:08.013606 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.014278 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.015907 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.016647 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.016715 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.016783 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.016851 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.016890 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":180,"threads_started":1}
I20260811 01:01:08.016954 27052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.012337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40001 (local address 127.0.0.1:47670)
0811 01:01:08.012693 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.012704 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:08.012760 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:08.013148 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:08.013149 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:08.013152 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:08.013199 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.013200 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.014465 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.014466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.015642 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.015645 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.016660 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.016661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.016725 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.016729 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:01:08.016774 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 01:01:08.016820 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":60,"thread_start_us":129,"threads_started":1}
I20260811 01:01:08.016950 27053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.012337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:37543 (local address 127.0.0.1:38990)
0811 01:01:08.012508 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.012553 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:08.012621 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:08.012882 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:08.012884 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:08.012886 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:08.012974 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.012976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.014395 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.014395 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.015691 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.015694 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.016554 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.016555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.016654 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.016670 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 01:01:08.016739 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 01:01:08.016802 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":72,"thread_start_us":54,"threads_started":1}
I20260811 01:01:08.016950 27056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.012334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:42019 (local address 127.0.0.1:51664)
0811 01:01:08.013218 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.013228 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:08.013273 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:08.013502 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:08.013503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:08.013505 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:08.013547 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.013549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.014356 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.014357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.015831 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.015833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.016729 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.016730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.016785 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.016789 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:01:08.016835 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:01:08.016872 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":848,"mutex_wait_us":65,"thread_start_us":95,"threads_started":1}
I20260811 01:01:08.017244 27060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.012539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38990 (local address 127.13.30.130:37543)
0811 01:01:08.012725 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.012731 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.012740 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:08.012781 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.012783 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.012799 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.012867 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:08.013053 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.014317 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.015785 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.016447 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.016528 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.016615 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.016985 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.017030 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":77,"threads_started":1}
I20260811 01:01:08.017256 27057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.012532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47670 (local address 127.13.30.129:40001)
0811 01:01:08.012993 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.012997 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.013005 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:01:08.013041 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.013044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.013059 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.013129 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:08.013296 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.014406 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.015744 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.016472 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.016546 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.016620 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.017106 (+ 486us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.017157 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":79,"threads_started":1}
I20260811 01:01:08.018004 26659 tablet_service.cc:1467] Processing CreateTablet for tablet 8e35d0ffad474c88895c4d0a67269ec3 (DEFAULT_TABLE table=test-table [id=87b783dd05ad41bf8be23b79b31a3274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:08.018328 26659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e35d0ffad474c88895c4d0a67269ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.021646 27063 tablet_bootstrap.cc:492] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03: Bootstrap starting.
I20260811 01:01:08.022045 26418 tablet_service.cc:1467] Processing CreateTablet for tablet 8e35d0ffad474c88895c4d0a67269ec3 (DEFAULT_TABLE table=test-table [id=87b783dd05ad41bf8be23b79b31a3274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:08.022264 27063 tablet_bootstrap.cc:654] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.022444 26418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e35d0ffad474c88895c4d0a67269ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.022622 27063 log.cc:824] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:08.022902 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 8e35d0ffad474c88895c4d0a67269ec3 (DEFAULT_TABLE table=test-table [id=87b783dd05ad41bf8be23b79b31a3274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:08.023237 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e35d0ffad474c88895c4d0a67269ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.023528 27063 tablet_bootstrap.cc:492] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03: No bootstrap required, opened a new log
I20260811 01:01:08.023604 27063 ts_tablet_manager.cc:1397] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:01:08.025787 27063 raft_consensus.cc:348] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } }
I20260811 01:01:08.026052 27063 raft_consensus.cc:374] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.026103 27063 raft_consensus.cc:729] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0365003bfb674fda8a3fd4f5ff14bf03, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.026002 27067 tablet_bootstrap.cc:492] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6: Bootstrap starting.
I20260811 01:01:08.026260 27063 consensus_queue.cc:260] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } }
I20260811 01:01:08.026609 27063 ts_tablet_manager.cc:1428] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:01:08.026747 26773 heartbeater.cc:503] Master 127.13.30.190:43903 was elected leader, sending a full tablet report...
I20260811 01:01:08.026947 27069 tablet_bootstrap.cc:492] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068: Bootstrap starting.
I20260811 01:01:08.027158 27067 tablet_bootstrap.cc:654] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.027522 27067 log.cc:824] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:08.028106 27069 tablet_bootstrap.cc:654] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.028357 27069 log.cc:824] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:08.029084 27069 tablet_bootstrap.cc:492] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068: No bootstrap required, opened a new log
I20260811 01:01:08.029079 27067 tablet_bootstrap.cc:492] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6: No bootstrap required, opened a new log
I20260811 01:01:08.029155 27069 ts_tablet_manager.cc:1397] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:01:08.029155 27067 ts_tablet_manager.cc:1397] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 01:01:08.031222 27069 raft_consensus.cc:348] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } }
I20260811 01:01:08.031222 27067 raft_consensus.cc:348] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } }
I20260811 01:01:08.031417 27069 raft_consensus.cc:374] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.031418 27067 raft_consensus.cc:374] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.031457 27067 raft_consensus.cc:729] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e44b32235440a3ba881eb58c78d3f6, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.031457 27069 raft_consensus.cc:729] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c209e007665c4f81909323290762f068, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.031589 27067 consensus_queue.cc:260] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } }
I20260811 01:01:08.031589 27069 consensus_queue.cc:260] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } }
I20260811 01:01:08.031894 27067 ts_tablet_manager.cc:1428] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:01:08.031895 27069 ts_tablet_manager.cc:1428] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:01:08.031927 26532 heartbeater.cc:503] Master 127.13.30.190:43903 was elected leader, sending a full tablet report...
I20260811 01:01:08.032058 27015 heartbeater.cc:503] Master 127.13.30.190:43903 was elected leader, sending a full tablet report...
W20260811 01:01:08.057313 26774 tablet.cc:2369] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:01:08.130136 26536 tablet.cc:2369] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:01:08.219550 27016 tablet.cc:2369] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:01:08.272586 27075 raft_consensus.cc:482] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:01:08.272732 27075 raft_consensus.cc:504] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } }
I20260811 01:01:08.273123 27075 leader_election.cc:288] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0365003bfb674fda8a3fd4f5ff14bf03 (127.13.30.130:37543), 00e44b32235440a3ba881eb58c78d3f6 (127.13.30.129:40001)
I20260811 01:01:08.275908 27057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.273460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:50613 (local address 127.13.30.129:40001)
0811 01:01:08.273516 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.273518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.273529 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:01:08.273561 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.273562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.273570 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.273637 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:08.273799 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.274275 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.275222 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.275584 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.275648 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.275658 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.275800 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.275841 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 01:01:08.275923 26825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.273367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40001 (local address 127.13.30.131:50613)
0811 01:01:08.273416 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.273428 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:08.273494 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:08.273656 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:08.273658 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:08.273660 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:08.273731 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.273733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.274353 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.274354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.275123 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.275125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.275653 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.275654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.275732 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.275735 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:01:08.275781 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:01:08.275825 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 01:01:08.275959 27060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.273463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:58921 (local address 127.13.30.130:37543)
0811 01:01:08.273516 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.273518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.273711 (+ 193us) server_negotiation.cc:407] Connection header received
0811 01:01:08.273748 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.273748 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.273757 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.273802 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:08.273951 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.274403 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.275289 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.275650 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.275710 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.275718 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.275855 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.275895 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 01:01:08.276016 27086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.273369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:37543 (local address 127.13.30.131:58921)
0811 01:01:08.273644 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.273652 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:08.273695 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:08.273820 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:08.273821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:08.273822 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:08.273888 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.273890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.274473 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.274474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.275201 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.275203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.275718 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.275718 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.275787 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.275790 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:01:08.275840 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 01:01:08.275879 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":85,"thread_start_us":134,"threads_started":1}
I20260811 01:01:08.276413 26688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e35d0ffad474c88895c4d0a67269ec3" candidate_uuid: "c209e007665c4f81909323290762f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" is_pre_election: true
I20260811 01:01:08.276402 26457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e35d0ffad474c88895c4d0a67269ec3" candidate_uuid: "c209e007665c4f81909323290762f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e44b32235440a3ba881eb58c78d3f6" is_pre_election: true
I20260811 01:01:08.276574 26688 raft_consensus.cc:2454] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c209e007665c4f81909323290762f068 in term 0.
I20260811 01:01:08.276574 26457 raft_consensus.cc:2454] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c209e007665c4f81909323290762f068 in term 0.
I20260811 01:01:08.277125 26817 leader_election.cc:302] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0365003bfb674fda8a3fd4f5ff14bf03, c209e007665c4f81909323290762f068; no voters:
I20260811 01:01:08.277271 27075 raft_consensus.cc:2781] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:01:08.277334 27075 raft_consensus.cc:482] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:01:08.277359 27075 raft_consensus.cc:3037] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.278146 27075 raft_consensus.cc:504] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } }
I20260811 01:01:08.278285 27075 leader_election.cc:288] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [CANDIDATE]: Term 1 election: Requested vote from peers 0365003bfb674fda8a3fd4f5ff14bf03 (127.13.30.130:37543), 00e44b32235440a3ba881eb58c78d3f6 (127.13.30.129:40001)
I20260811 01:01:08.278477 26688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e35d0ffad474c88895c4d0a67269ec3" candidate_uuid: "c209e007665c4f81909323290762f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0365003bfb674fda8a3fd4f5ff14bf03"
I20260811 01:01:08.278558 26688 raft_consensus.cc:3037] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.279278 26688 raft_consensus.cc:2454] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c209e007665c4f81909323290762f068 in term 1.
I20260811 01:01:08.279423 26457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e35d0ffad474c88895c4d0a67269ec3" candidate_uuid: "c209e007665c4f81909323290762f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e44b32235440a3ba881eb58c78d3f6"
I20260811 01:01:08.279502 26817 leader_election.cc:302] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0365003bfb674fda8a3fd4f5ff14bf03, c209e007665c4f81909323290762f068; no voters:
I20260811 01:01:08.279515 26457 raft_consensus.cc:3037] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.279597 27075 raft_consensus.cc:2781] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:01:08.279747 27075 raft_consensus.cc:686] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [term 1 LEADER]: Becoming Leader. State: Replica: c209e007665c4f81909323290762f068, State: Running, Role: LEADER
I20260811 01:01:08.279886 27075 consensus_queue.cc:237] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } }
I20260811 01:01:08.280376 26457 raft_consensus.cc:2454] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c209e007665c4f81909323290762f068 in term 1.
I20260811 01:01:08.280833 26179 catalog_manager.cc:5495] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 reported cstate change: term changed from 0 to 1, leader changed from <none> to c209e007665c4f81909323290762f068 (127.13.30.131). New cstate: current_term: 1 leader_uuid: "c209e007665c4f81909323290762f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } health_report { overall_health: UNKNOWN } } }
I20260811 01:01:08.301978 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.299685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51676 (local address 127.13.30.131:42019)
0811 01:01:08.299734 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.299736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.299745 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:08.299791 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.299792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.299814 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.299886 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:01:08.300020 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.300495 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.301213 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.301411 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.301509 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.301655 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:01:08.301764 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:01:08.301834 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.301870 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.301893 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 01:01:08.303977 26688 raft_consensus.cc:1261] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Refusing update from remote peer c209e007665c4f81909323290762f068: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:08.303977 26457 raft_consensus.cc:1261] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Refusing update from remote peer c209e007665c4f81909323290762f068: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:08.304325 27075 consensus_queue.cc:1035] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:08.304478 27089 consensus_queue.cc:1035] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:08.307211 27097 mvcc.cc:205] Tried to move back new op lower bound from 7317135639770017792 to 7317135639674970112. Current Snapshot: MvccSnapshot[applied={T|T < 7317135639770017792}]
I20260811 01:01:08.307901 27096 mvcc.cc:205] Tried to move back new op lower bound from 7317135639770017792 to 7317135639674970112. Current Snapshot: MvccSnapshot[applied={T|T < 7317135639770017792}]
I20260811 01:01:08.309580 26182 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:01:08.309711 26182 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:01:08.310465 26182 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d: Sending DeleteTablet for 3 replicas of tablet 8e35d0ffad474c88895c4d0a67269ec3
I20260811 01:01:08.310793 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e35d0ffad474c88895c4d0a67269ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:08 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:51664
I20260811 01:01:08.310854 26659 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e35d0ffad474c88895c4d0a67269ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:08 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:38990
I20260811 01:01:08.311038 27109 tablet_replica.cc:330] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068: stopping tablet replica
I20260811 01:01:08.311070 27110 tablet_replica.cc:330] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03: stopping tablet replica
I20260811 01:01:08.311173 27110 raft_consensus.cc:2229] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:08.311182 26418 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e35d0ffad474c88895c4d0a67269ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:08 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:47670
I20260811 01:01:08.311180 27109 raft_consensus.cc:2229] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:01:08.311290 27110 raft_consensus.cc:2258] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:08.311419 27109 raft_consensus.cc:2258] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:08.311615 26182 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:01:08.311776 26182 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:01:08.311774 27110 ts_tablet_manager.cc:1905] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:08.312212 27114 tablet_replica.cc:330] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6: stopping tablet replica
I20260811 01:01:08.312323 27114 raft_consensus.cc:2229] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:08.312424 27114 raft_consensus.cc:2258] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:08.312880 27114 ts_tablet_manager.cc:1905] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:08.313510 27110 ts_tablet_manager.cc:1918] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:01:08.313586 27110 log.cc:1196] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/8e35d0ffad474c88895c4d0a67269ec3
I20260811 01:01:08.313853 27110 ts_tablet_manager.cc:1939] T 8e35d0ffad474c88895c4d0a67269ec3 P 0365003bfb674fda8a3fd4f5ff14bf03: Deleting consensus metadata
I20260811 01:01:08.313863 26418 tablet_service.cc:1467] Processing CreateTablet for tablet b95a1b73d3f743e796c3ef7b58c685a5 (DEFAULT_TABLE table=test-table [id=ec59e7bf00494fcdbf42958bf2c12940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:08.313966 26418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b95a1b73d3f743e796c3ef7b58c685a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.314532 27114 ts_tablet_manager.cc:1918] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:01:08.314595 27114 log.cc:1196] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/wal/wals/8e35d0ffad474c88895c4d0a67269ec3
I20260811 01:01:08.314827 27114 ts_tablet_manager.cc:1939] T 8e35d0ffad474c88895c4d0a67269ec3 P 00e44b32235440a3ba881eb58c78d3f6: Deleting consensus metadata
I20260811 01:01:08.315157 27067 tablet_bootstrap.cc:492] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6: Bootstrap starting.
I20260811 01:01:08.315196 26659 tablet_service.cc:1467] Processing CreateTablet for tablet b95a1b73d3f743e796c3ef7b58c685a5 (DEFAULT_TABLE table=test-table [id=ec59e7bf00494fcdbf42958bf2c12940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:08.315301 26659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b95a1b73d3f743e796c3ef7b58c685a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.315280 26161 catalog_manager.cc:4841] TS 00e44b32235440a3ba881eb58c78d3f6 (127.13.30.129:40001): tablet 8e35d0ffad474c88895c4d0a67269ec3 (table test-table [id=87b783dd05ad41bf8be23b79b31a3274]) successfully deleted
I20260811 01:01:08.315547 27067 tablet_bootstrap.cc:654] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.316118 27067 tablet_bootstrap.cc:492] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6: No bootstrap required, opened a new log
I20260811 01:01:08.316161 27067 ts_tablet_manager.cc:1397] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:08.316300 27067 raft_consensus.cc:348] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.316363 27067 raft_consensus.cc:374] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.316380 27067 raft_consensus.cc:729] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e44b32235440a3ba881eb58c78d3f6, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.316438 27067 consensus_queue.cc:260] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.316665 27063 tablet_bootstrap.cc:492] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03: Bootstrap starting.
I20260811 01:01:08.316697 26888 tablet_service.cc:1467] Processing CreateTablet for tablet b95a1b73d3f743e796c3ef7b58c685a5 (DEFAULT_TABLE table=test-table [id=ec59e7bf00494fcdbf42958bf2c12940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:08.316756 27067 ts_tablet_manager.cc:1428] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:08.316813 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b95a1b73d3f743e796c3ef7b58c685a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.317296 27063 tablet_bootstrap.cc:654] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.317945 27063 tablet_bootstrap.cc:492] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03: No bootstrap required, opened a new log
I20260811 01:01:08.317988 27063 ts_tablet_manager.cc:1397] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:08.318120 27069 tablet_bootstrap.cc:492] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068: Bootstrap starting.
I20260811 01:01:08.318100 27063 raft_consensus.cc:348] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.318167 27063 raft_consensus.cc:374] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.318187 27063 raft_consensus.cc:729] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0365003bfb674fda8a3fd4f5ff14bf03, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.318228 27063 consensus_queue.cc:260] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.318228 26162 catalog_manager.cc:4841] TS 0365003bfb674fda8a3fd4f5ff14bf03 (127.13.30.130:37543): tablet 8e35d0ffad474c88895c4d0a67269ec3 (table test-table [id=87b783dd05ad41bf8be23b79b31a3274]) successfully deleted
I20260811 01:01:08.318316 27063 ts_tablet_manager.cc:1428] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:08.318547 27069 tablet_bootstrap.cc:654] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.319094 27109 ts_tablet_manager.cc:1905] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:08.319197 27069 tablet_bootstrap.cc:492] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068: No bootstrap required, opened a new log
I20260811 01:01:08.319242 27069 ts_tablet_manager.cc:1397] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:08.319403 27069 raft_consensus.cc:348] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.319489 27069 raft_consensus.cc:374] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.319530 27069 raft_consensus.cc:729] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c209e007665c4f81909323290762f068, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.319569 27069 consensus_queue.cc:260] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.319664 27069 ts_tablet_manager.cc:1428] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:08.320523 27109 ts_tablet_manager.cc:1918] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:01:08.320582 27109 log.cc:1196] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/8e35d0ffad474c88895c4d0a67269ec3
I20260811 01:01:08.320781 27109 ts_tablet_manager.cc:1939] T 8e35d0ffad474c88895c4d0a67269ec3 P c209e007665c4f81909323290762f068: Deleting consensus metadata
I20260811 01:01:08.321166 26163 catalog_manager.cc:4841] TS c209e007665c4f81909323290762f068 (127.13.30.131:42019): tablet 8e35d0ffad474c88895c4d0a67269ec3 (table test-table [id=87b783dd05ad41bf8be23b79b31a3274]) successfully deleted
I20260811 01:01:08.359195 27075 raft_consensus.cc:482] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:01:08.359335 27075 raft_consensus.cc:504] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.359519 27075 leader_election.cc:288] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00e44b32235440a3ba881eb58c78d3f6 (127.13.30.129:40001), 0365003bfb674fda8a3fd4f5ff14bf03 (127.13.30.130:37543)
I20260811 01:01:08.359769 26688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b95a1b73d3f743e796c3ef7b58c685a5" candidate_uuid: "c209e007665c4f81909323290762f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" is_pre_election: true
I20260811 01:01:08.359769 26457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b95a1b73d3f743e796c3ef7b58c685a5" candidate_uuid: "c209e007665c4f81909323290762f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e44b32235440a3ba881eb58c78d3f6" is_pre_election: true
I20260811 01:01:08.359892 26457 raft_consensus.cc:2454] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c209e007665c4f81909323290762f068 in term 0.
I20260811 01:01:08.359892 26688 raft_consensus.cc:2454] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c209e007665c4f81909323290762f068 in term 0.
I20260811 01:01:08.360059 26815 leader_election.cc:302] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e44b32235440a3ba881eb58c78d3f6, c209e007665c4f81909323290762f068; no voters:
I20260811 01:01:08.360169 27075 raft_consensus.cc:2781] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:01:08.360201 27075 raft_consensus.cc:482] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:01:08.360220 27075 raft_consensus.cc:3037] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.361052 27075 raft_consensus.cc:504] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.361210 27075 leader_election.cc:288] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [CANDIDATE]: Term 1 election: Requested vote from peers 00e44b32235440a3ba881eb58c78d3f6 (127.13.30.129:40001), 0365003bfb674fda8a3fd4f5ff14bf03 (127.13.30.130:37543)
I20260811 01:01:08.361461 26688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b95a1b73d3f743e796c3ef7b58c685a5" candidate_uuid: "c209e007665c4f81909323290762f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0365003bfb674fda8a3fd4f5ff14bf03"
I20260811 01:01:08.361483 26457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b95a1b73d3f743e796c3ef7b58c685a5" candidate_uuid: "c209e007665c4f81909323290762f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e44b32235440a3ba881eb58c78d3f6"
I20260811 01:01:08.361557 26688 raft_consensus.cc:3037] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.361572 26457 raft_consensus.cc:3037] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.362280 26457 raft_consensus.cc:2454] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c209e007665c4f81909323290762f068 in term 1.
I20260811 01:01:08.362356 26688 raft_consensus.cc:2454] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c209e007665c4f81909323290762f068 in term 1.
I20260811 01:01:08.362479 26815 leader_election.cc:302] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e44b32235440a3ba881eb58c78d3f6, c209e007665c4f81909323290762f068; no voters:
I20260811 01:01:08.362596 27075 raft_consensus.cc:2781] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:01:08.362643 27075 raft_consensus.cc:686] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [term 1 LEADER]: Becoming Leader. State: Replica: c209e007665c4f81909323290762f068, State: Running, Role: LEADER
I20260811 01:01:08.362691 27075 consensus_queue.cc:237] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.363327 26179 catalog_manager.cc:5495] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 reported cstate change: term changed from 0 to 1, leader changed from <none> to c209e007665c4f81909323290762f068 (127.13.30.131). New cstate: current_term: 1 leader_uuid: "c209e007665c4f81909323290762f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } health_report { overall_health: HEALTHY } } }
Aug 11 01:01:08 dist-test-slave-42z9 krb5kdc[26112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410067, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.190@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:08.398507 27134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.390260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:43903 (local address 127.0.0.1:44892)
0811 01:01:08.390460 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.390472 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:08.390567 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:08.390715 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:08.390716 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:08.391151 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:08.391234 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.391238 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.391942 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.391943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.392797 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.392800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.393134 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.393136 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.393201 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.393805 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:08.393811 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:08.395431 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:08.397213 (+ 1782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:08.397221 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:08.397223 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:08.397620 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:08.397848 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:08.397849 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:08.397849 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:08.397913 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:08.398185 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:08.398191 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:08.398236 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 01:01:08.398286 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 01:01:08.398423 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":105,"threads_started":1}
I20260811 01:01:08.398620 26271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.390333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44892 (local address 127.13.30.190:43903)
0811 01:01:08.390404 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.390406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.390555 (+ 149us) server_negotiation.cc:407] Connection header received
0811 01:01:08.390629 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.390630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.390640 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.390689 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:08.391315 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.391841 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.392885 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.393064 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.393106 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.395540 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:08.395542 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:08.395543 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:08.395551 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:08.397125 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:08.397703 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:08.397705 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:08.397705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:08.397775 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:08.397973 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:08.397974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:08.397974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:08.398125 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:08.398196 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.398323 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.398504 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":77,"server-negotiator.queue_time_us":41}
I20260811 01:01:08.400930 26179 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:44892:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 01:01:08.401187 26179 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:01:08.402745 26418 tablet_service.cc:1467] Processing CreateTablet for tablet 65d941b536c746a4b6f7a8acfe9cf32a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c83700cb20b24072ae1e960961da62ea]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:01:08.402732 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 65d941b536c746a4b6f7a8acfe9cf32a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c83700cb20b24072ae1e960961da62ea]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:01:08.402751 26659 tablet_service.cc:1467] Processing CreateTablet for tablet 65d941b536c746a4b6f7a8acfe9cf32a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c83700cb20b24072ae1e960961da62ea]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:01:08.402912 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65d941b536c746a4b6f7a8acfe9cf32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.402913 26418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65d941b536c746a4b6f7a8acfe9cf32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.402917 26659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65d941b536c746a4b6f7a8acfe9cf32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.404508 27063 tablet_bootstrap.cc:492] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03: Bootstrap starting.
I20260811 01:01:08.404498 27067 tablet_bootstrap.cc:492] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6: Bootstrap starting.
I20260811 01:01:08.404940 27067 tablet_bootstrap.cc:654] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.404958 27063 tablet_bootstrap.cc:654] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.405305 27069 tablet_bootstrap.cc:492] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068: Bootstrap starting.
I20260811 01:01:08.405857 27069 tablet_bootstrap.cc:654] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.406421 27067 tablet_bootstrap.cc:492] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6: No bootstrap required, opened a new log
I20260811 01:01:08.406474 27067 ts_tablet_manager.cc:1397] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:01:08.406497 27069 tablet_bootstrap.cc:492] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068: No bootstrap required, opened a new log
I20260811 01:01:08.406543 27069 ts_tablet_manager.cc:1397] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:08.406679 27067 raft_consensus.cc:348] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.406692 27069 raft_consensus.cc:348] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.406755 27067 raft_consensus.cc:374] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.406776 27067 raft_consensus.cc:729] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e44b32235440a3ba881eb58c78d3f6, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.406759 27069 raft_consensus.cc:374] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.406800 27069 raft_consensus.cc:729] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c209e007665c4f81909323290762f068, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.406822 27067 consensus_queue.cc:260] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.406843 27069 consensus_queue.cc:260] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.406916 27067 ts_tablet_manager.cc:1428] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:08.406924 27069 ts_tablet_manager.cc:1428] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:08.407004 27075 tablet_replica.cc:439] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } }
I20260811 01:01:08.407079 27075 tablet_replica.cc:442] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:01:08.407060 27081 tablet_replica.cc:439] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } }
I20260811 01:01:08.407133 27081 tablet_replica.cc:442] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:01:08.408061 27063 tablet_bootstrap.cc:492] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03: No bootstrap required, opened a new log
I20260811 01:01:08.408125 27063 ts_tablet_manager.cc:1397] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 01:01:08.408275 27063 raft_consensus.cc:348] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.408347 27063 raft_consensus.cc:374] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.408365 27063 raft_consensus.cc:729] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0365003bfb674fda8a3fd4f5ff14bf03, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.408417 27063 consensus_queue.cc:260] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.408522 27063 ts_tablet_manager.cc:1428] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:08.408612 27068 tablet_replica.cc:439] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } }
I20260811 01:01:08.408711 27068 tablet_replica.cc:442] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:01:08.536540 27075 raft_consensus.cc:482] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:01:08.536651 27075 raft_consensus.cc:504] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.536799 27075 leader_election.cc:288] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00e44b32235440a3ba881eb58c78d3f6 (127.13.30.129:40001), 0365003bfb674fda8a3fd4f5ff14bf03 (127.13.30.130:37543)
I20260811 01:01:08.537034 26688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65d941b536c746a4b6f7a8acfe9cf32a" candidate_uuid: "c209e007665c4f81909323290762f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" is_pre_election: true
I20260811 01:01:08.537031 26457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65d941b536c746a4b6f7a8acfe9cf32a" candidate_uuid: "c209e007665c4f81909323290762f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e44b32235440a3ba881eb58c78d3f6" is_pre_election: true
I20260811 01:01:08.537119 26688 raft_consensus.cc:2454] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c209e007665c4f81909323290762f068 in term 0.
I20260811 01:01:08.537134 26457 raft_consensus.cc:2454] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c209e007665c4f81909323290762f068 in term 0.
I20260811 01:01:08.537272 26817 leader_election.cc:302] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0365003bfb674fda8a3fd4f5ff14bf03, c209e007665c4f81909323290762f068; no voters:
I20260811 01:01:08.537382 27075 raft_consensus.cc:2781] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:01:08.537420 27075 raft_consensus.cc:482] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:01:08.537433 27075 raft_consensus.cc:3037] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.538168 27075 raft_consensus.cc:504] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.538309 27075 leader_election.cc:288] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [CANDIDATE]: Term 1 election: Requested vote from peers 00e44b32235440a3ba881eb58c78d3f6 (127.13.30.129:40001), 0365003bfb674fda8a3fd4f5ff14bf03 (127.13.30.130:37543)
I20260811 01:01:08.538468 26688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65d941b536c746a4b6f7a8acfe9cf32a" candidate_uuid: "c209e007665c4f81909323290762f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0365003bfb674fda8a3fd4f5ff14bf03"
I20260811 01:01:08.538476 26457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65d941b536c746a4b6f7a8acfe9cf32a" candidate_uuid: "c209e007665c4f81909323290762f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e44b32235440a3ba881eb58c78d3f6"
I20260811 01:01:08.538538 26688 raft_consensus.cc:3037] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.538547 26457 raft_consensus.cc:3037] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.539147 26457 raft_consensus.cc:2454] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c209e007665c4f81909323290762f068 in term 1.
I20260811 01:01:08.539147 26688 raft_consensus.cc:2454] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c209e007665c4f81909323290762f068 in term 1.
I20260811 01:01:08.539324 26817 leader_election.cc:302] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0365003bfb674fda8a3fd4f5ff14bf03, c209e007665c4f81909323290762f068; no voters:
I20260811 01:01:08.539443 27075 raft_consensus.cc:2781] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:01:08.539492 27075 raft_consensus.cc:686] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [term 1 LEADER]: Becoming Leader. State: Replica: c209e007665c4f81909323290762f068, State: Running, Role: LEADER
I20260811 01:01:08.539541 27075 consensus_queue.cc:237] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.539834 27104 tablet_replica.cc:439] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068: TxnStatusTablet state changed. Reason: New leader c209e007665c4f81909323290762f068. Latest consensus state: current_term: 1 leader_uuid: "c209e007665c4f81909323290762f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } }
I20260811 01:01:08.539932 27104 tablet_replica.cc:442] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:01:08.540096 27141 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 01:01:08.540203 27141 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 01:01:08.540179 26182 catalog_manager.cc:5495] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 reported cstate change: term changed from 0 to 1, leader changed from <none> to c209e007665c4f81909323290762f068 (127.13.30.131). New cstate: current_term: 1 leader_uuid: "c209e007665c4f81909323290762f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } health_report { overall_health: HEALTHY } } }
I20260811 01:01:08.555745 27134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.553070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:42019 (local address 127.0.0.1:51678)
0811 01:01:08.553160 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.553172 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:08.553224 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:08.553371 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:08.553371 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:08.553372 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:01:08.553426 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.553428 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.554359 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.554360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.554936 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.554938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.555390 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.555390 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.555433 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.555450 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:01:08.555604 (+ 154us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:01:08.555608 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:01:08.555639 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 01:01:08.555679 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 01:01:08.555756 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.553126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51678 (local address 127.13.30.131:42019)
0811 01:01:08.553194 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.553196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.553207 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:01:08.553290 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.553291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.553303 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.553368 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:01:08.553515 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.554282 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.555017 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.555319 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.555394 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.555521 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:01:08.555556 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:01:08.555602 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.555647 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.555671 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 01:01:08.556885 26688 raft_consensus.cc:1261] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Refusing update from remote peer c209e007665c4f81909323290762f068: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:08.556885 26457 raft_consensus.cc:1261] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Refusing update from remote peer c209e007665c4f81909323290762f068: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:08.557134 27104 consensus_queue.cc:1035] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:08.557257 27075 consensus_queue.cc:1035] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:08.557796 27068 tablet_replica.cc:439] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03: TxnStatusTablet state changed. Reason: New leader c209e007665c4f81909323290762f068. Latest consensus state: current_term: 1 leader_uuid: "c209e007665c4f81909323290762f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } }
I20260811 01:01:08.557919 27068 tablet_replica.cc:442] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:01:08.557969 27081 tablet_replica.cc:439] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6: TxnStatusTablet state changed. Reason: New leader c209e007665c4f81909323290762f068. Latest consensus state: current_term: 1 leader_uuid: "c209e007665c4f81909323290762f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } }
I20260811 01:01:08.558072 27081 tablet_replica.cc:442] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:01:08.558568 27104 tablet_replica.cc:439] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c209e007665c4f81909323290762f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } }
I20260811 01:01:08.558663 27104 tablet_replica.cc:442] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:01:08.558957 27095 mvcc.cc:205] Tried to move back new op lower bound from 7317135640807202816 to 7317135640738402304. Current Snapshot: MvccSnapshot[applied={T|T < 7317135640807202816 or (T in {7317135640807202816})}]
I20260811 01:01:08.559063 27068 tablet_replica.cc:439] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c209e007665c4f81909323290762f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } }
I20260811 01:01:08.559146 27068 tablet_replica.cc:442] T 65d941b536c746a4b6f7a8acfe9cf32a P 0365003bfb674fda8a3fd4f5ff14bf03: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:01:08.561497 27104 tablet_replica.cc:439] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c209e007665c4f81909323290762f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } }
I20260811 01:01:08.561599 27104 tablet_replica.cc:442] T 65d941b536c746a4b6f7a8acfe9cf32a P c209e007665c4f81909323290762f068: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:01:08.561703 27081 tablet_replica.cc:439] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c209e007665c4f81909323290762f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } } }
I20260811 01:01:08.561798 27081 tablet_replica.cc:442] T 65d941b536c746a4b6f7a8acfe9cf32a P 00e44b32235440a3ba881eb58c78d3f6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:01:08.565429 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.563146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:40645 (local address 127.13.30.131:42019)
0811 01:01:08.563205 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.563208 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.563308 (+ 100us) server_negotiation.cc:407] Connection header received
0811 01:01:08.563395 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.563396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.563406 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.563457 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:01:08.563578 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.564050 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.564776 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.564971 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.565028 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.565186 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:01:08.565219 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:01:08.565259 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.565314 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.565334 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":35}
I20260811 01:01:08.565433 27149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.563077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:42019 (local address 127.13.30.131:40645)
0811 01:01:08.563247 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.563257 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:08.563314 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:08.563461 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:08.563461 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:08.563463 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:01:08.563526 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.563528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.564120 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.564121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.564701 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.564703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.565033 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.565034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.565095 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.565114 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:01:08.565265 (+ 151us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:01:08.565266 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 01:01:08.565303 (+ 37us) client_negotiation.cc:240] Negotiation successful
0811 01:01:08.565364 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":85,"threads_started":1}
I20260811 01:01:08.567917 26457 raft_consensus.cc:1261] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Refusing update from remote peer c209e007665c4f81909323290762f068: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:08.567907 26688 raft_consensus.cc:1261] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Refusing update from remote peer c209e007665c4f81909323290762f068: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:08.568125 27104 consensus_queue.cc:1035] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:08.568249 27075 consensus_queue.cc:1035] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:08.583205 26178 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:01:08.583325 26178 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:01:08.584030 26178 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d: Sending DeleteTablet for 3 replicas of tablet b95a1b73d3f743e796c3ef7b58c685a5
I20260811 01:01:08.584443 26418 tablet_service.cc:1514] Processing DeleteTablet for tablet b95a1b73d3f743e796c3ef7b58c685a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:08 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:47670
I20260811 01:01:08.584568 27114 tablet_replica.cc:330] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6: stopping tablet replica
I20260811 01:01:08.584594 26659 tablet_service.cc:1514] Processing DeleteTablet for tablet b95a1b73d3f743e796c3ef7b58c685a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:08 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:38990
I20260811 01:01:08.584631 27114 raft_consensus.cc:2229] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:08.584671 27114 raft_consensus.cc:2258] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:08.584712 27110 tablet_replica.cc:330] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03: stopping tablet replica
I20260811 01:01:08.584802 27110 raft_consensus.cc:2229] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:08.584863 27110 raft_consensus.cc:2258] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:08.584863 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet b95a1b73d3f743e796c3ef7b58c685a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:08 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:51664
I20260811 01:01:08.584961 27109 tablet_replica.cc:330] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068: stopping tablet replica
I20260811 01:01:08.585011 27109 raft_consensus.cc:2229] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:01:08.585037 27114 ts_tablet_manager.cc:1905] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:08.585067 27109 raft_consensus.cc:2258] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:08.585471 27109 ts_tablet_manager.cc:1905] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:08.585920 27110 ts_tablet_manager.cc:1905] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:08.586881 27114 ts_tablet_manager.cc:1918] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:01:08.586941 27114 log.cc:1196] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/wal/wals/b95a1b73d3f743e796c3ef7b58c685a5
I20260811 01:01:08.587137 27114 ts_tablet_manager.cc:1939] T b95a1b73d3f743e796c3ef7b58c685a5 P 00e44b32235440a3ba881eb58c78d3f6: Deleting consensus metadata
I20260811 01:01:08.587306 27109 ts_tablet_manager.cc:1918] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:01:08.587423 27109 log.cc:1196] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/b95a1b73d3f743e796c3ef7b58c685a5
I20260811 01:01:08.587586 27110 ts_tablet_manager.cc:1918] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:01:08.587630 27109 ts_tablet_manager.cc:1939] T b95a1b73d3f743e796c3ef7b58c685a5 P c209e007665c4f81909323290762f068: Deleting consensus metadata
I20260811 01:01:08.587647 27110 log.cc:1196] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/b95a1b73d3f743e796c3ef7b58c685a5
I20260811 01:01:08.587829 27110 ts_tablet_manager.cc:1939] T b95a1b73d3f743e796c3ef7b58c685a5 P 0365003bfb674fda8a3fd4f5ff14bf03: Deleting consensus metadata
I20260811 01:01:08.588057 26163 catalog_manager.cc:4841] TS c209e007665c4f81909323290762f068 (127.13.30.131:42019): tablet b95a1b73d3f743e796c3ef7b58c685a5 (table test-table [id=ec59e7bf00494fcdbf42958bf2c12940]) successfully deleted
I20260811 01:01:08.588264 26161 catalog_manager.cc:4841] TS 00e44b32235440a3ba881eb58c78d3f6 (127.13.30.129:40001): tablet b95a1b73d3f743e796c3ef7b58c685a5 (table test-table [id=ec59e7bf00494fcdbf42958bf2c12940]) successfully deleted
I20260811 01:01:08.588717 26162 catalog_manager.cc:4841] TS 0365003bfb674fda8a3fd4f5ff14bf03 (127.13.30.130:37543): tablet b95a1b73d3f743e796c3ef7b58c685a5 (table test-table [id=ec59e7bf00494fcdbf42958bf2c12940]) successfully deleted
Aug 11 01:01:08 dist-test-slave-42z9 krb5kdc[26112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:01:08 dist-test-slave-42z9 krb5kdc[26112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:08 dist-test-slave-42z9 krb5kdc[26112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 01:01:08.611799 26271 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:08.604962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44896 (local address 127.13.30.190:43903)
0811 01:01:08.605022 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.605024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.605282 (+ 258us) server_negotiation.cc:407] Connection header received
0811 01:01:08.605371 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.605372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.605382 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.605527 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:08.606369 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.606923 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.608071 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.608294 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.608355 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.611723 (+ 3368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44896: BlockingRecv error: recv got EOF from 127.0.0.1:44896 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 11 01:01:08 dist-test-slave-42z9 krb5kdc[26112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM
I20260811 01:01:08.619705 26271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.612647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44898 (local address 127.13.30.190:43903)
0811 01:01:08.612715 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.612717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.612727 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:01:08.612781 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.612782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.612793 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.612839 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:08.613295 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.613849 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.614531 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.614731 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.614786 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.617239 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:08.617240 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:08.617240 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:08.617248 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:08.618602 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:08.619001 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:08.619002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:08.619002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:08.619049 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:08.619241 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:08.619241 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:08.619242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:08.619353 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:08.619421 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.619567 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.619631 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 01:01:08.621289 26178 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44898:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:01:08.621515 26178 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:01:08.623004 26659 tablet_service.cc:1467] Processing CreateTablet for tablet 455e8a0b715f4a29be5a5ad0a05924a6 (DEFAULT_TABLE table=test-table [id=6520ad2a1693486a86b7d0d9fbd30025]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:08.623030 26418 tablet_service.cc:1467] Processing CreateTablet for tablet 455e8a0b715f4a29be5a5ad0a05924a6 (DEFAULT_TABLE table=test-table [id=6520ad2a1693486a86b7d0d9fbd30025]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:08.623042 26888 tablet_service.cc:1467] Processing CreateTablet for tablet 455e8a0b715f4a29be5a5ad0a05924a6 (DEFAULT_TABLE table=test-table [id=6520ad2a1693486a86b7d0d9fbd30025]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:08.623168 26418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 455e8a0b715f4a29be5a5ad0a05924a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.623168 26659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 455e8a0b715f4a29be5a5ad0a05924a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.623193 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 455e8a0b715f4a29be5a5ad0a05924a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.624532 27063 tablet_bootstrap.cc:492] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03: Bootstrap starting.
I20260811 01:01:08.624553 27067 tablet_bootstrap.cc:492] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6: Bootstrap starting.
I20260811 01:01:08.624778 27069 tablet_bootstrap.cc:492] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068: Bootstrap starting.
I20260811 01:01:08.624976 27067 tablet_bootstrap.cc:654] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.624975 27063 tablet_bootstrap.cc:654] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.625095 27069 tablet_bootstrap.cc:654] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.625960 27063 tablet_bootstrap.cc:492] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03: No bootstrap required, opened a new log
I20260811 01:01:08.625965 27067 tablet_bootstrap.cc:492] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6: No bootstrap required, opened a new log
I20260811 01:01:08.626012 27063 ts_tablet_manager.cc:1397] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:08.626012 27067 ts_tablet_manager.cc:1397] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:08.626044 27069 tablet_bootstrap.cc:492] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068: No bootstrap required, opened a new log
I20260811 01:01:08.626092 27069 ts_tablet_manager.cc:1397] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:08.626175 27063 raft_consensus.cc:348] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.626175 27067 raft_consensus.cc:348] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.626197 27069 raft_consensus.cc:348] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.626247 27063 raft_consensus.cc:374] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.626247 27067 raft_consensus.cc:374] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.626262 27069 raft_consensus.cc:374] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.626268 27067 raft_consensus.cc:729] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e44b32235440a3ba881eb58c78d3f6, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.626267 27063 raft_consensus.cc:729] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0365003bfb674fda8a3fd4f5ff14bf03, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.626282 27069 raft_consensus.cc:729] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c209e007665c4f81909323290762f068, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.626312 27063 consensus_queue.cc:260] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.626312 27067 consensus_queue.cc:260] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.626325 27069 consensus_queue.cc:260] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.626399 27063 ts_tablet_manager.cc:1428] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:08.626426 27067 ts_tablet_manager.cc:1428] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:08.626441 27069 ts_tablet_manager.cc:1428] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:08.651829 27068 raft_consensus.cc:482] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:01:08.651957 27068 raft_consensus.cc:504] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.652307 27068 leader_election.cc:288] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00e44b32235440a3ba881eb58c78d3f6 (127.13.30.129:40001), c209e007665c4f81909323290762f068 (127.13.30.131:42019)
I20260811 01:01:08.655917 27057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.652614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:58521 (local address 127.13.30.129:40001)
0811 01:01:08.652757 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.652759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.652769 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:01:08.652826 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.652828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.652838 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.652872 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:08.653111 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.653867 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.655189 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.655562 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.655628 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.655638 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.655806 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.655849 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260811 01:01:08.656250 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.652757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:38025 (local address 127.13.30.131:42019)
0811 01:01:08.652806 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.652808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.652913 (+ 105us) server_negotiation.cc:407] Connection header received
0811 01:01:08.652947 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.652948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.652958 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.653024 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:08.653159 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.653672 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.655184 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.655772 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.655849 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.655862 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.656129 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.656176 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 01:01:08.656502 27182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.652534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40001 (local address 127.13.30.130:58521)
0811 01:01:08.652682 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.652694 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:08.652758 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:08.652954 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:08.652955 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:08.652957 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:08.653043 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.653046 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.653981 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.653982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.655073 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.655078 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.655671 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.655673 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.655730 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.655734 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:01:08.655781 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 01:01:08.655827 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":2,"thread_start_us":73,"threads_started":1}
I20260811 01:01:08.656590 27184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.652547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:42019 (local address 127.13.30.130:38025)
0811 01:01:08.652836 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.652846 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:08.652901 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:08.653030 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:08.653031 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:08.653032 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:08.653095 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.653096 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.653758 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.653759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.655081 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.655083 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.655952 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.655954 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.656037 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.656041 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:01:08.656402 (+ 361us) client_negotiation.cc:240] Negotiation successful
0811 01:01:08.656458 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":33,"thread_start_us":99,"threads_started":1}
I20260811 01:01:08.656770 26457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "455e8a0b715f4a29be5a5ad0a05924a6" candidate_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e44b32235440a3ba881eb58c78d3f6" is_pre_election: true
I20260811 01:01:08.656880 26457 raft_consensus.cc:2454] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0365003bfb674fda8a3fd4f5ff14bf03 in term 0.
I20260811 01:01:08.657042 26942 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "455e8a0b715f4a29be5a5ad0a05924a6" candidate_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c209e007665c4f81909323290762f068" is_pre_election: true
I20260811 01:01:08.657084 26576 leader_election.cc:302] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e44b32235440a3ba881eb58c78d3f6, 0365003bfb674fda8a3fd4f5ff14bf03; no voters:
I20260811 01:01:08.657186 26942 raft_consensus.cc:2454] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0365003bfb674fda8a3fd4f5ff14bf03 in term 0.
I20260811 01:01:08.657215 27068 raft_consensus.cc:2781] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:01:08.657243 27068 raft_consensus.cc:482] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:01:08.657261 27068 raft_consensus.cc:3037] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.658044 27068 raft_consensus.cc:504] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.658171 27068 leader_election.cc:288] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [CANDIDATE]: Term 1 election: Requested vote from peers 00e44b32235440a3ba881eb58c78d3f6 (127.13.30.129:40001), c209e007665c4f81909323290762f068 (127.13.30.131:42019)
I20260811 01:01:08.658365 26457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "455e8a0b715f4a29be5a5ad0a05924a6" candidate_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e44b32235440a3ba881eb58c78d3f6"
I20260811 01:01:08.658437 26457 raft_consensus.cc:3037] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.659040 26457 raft_consensus.cc:2454] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0365003bfb674fda8a3fd4f5ff14bf03 in term 1.
I20260811 01:01:08.659152 26942 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "455e8a0b715f4a29be5a5ad0a05924a6" candidate_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c209e007665c4f81909323290762f068"
I20260811 01:01:08.659204 26576 leader_election.cc:302] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e44b32235440a3ba881eb58c78d3f6, 0365003bfb674fda8a3fd4f5ff14bf03; no voters:
I20260811 01:01:08.659231 26942 raft_consensus.cc:3037] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.659337 27068 raft_consensus.cc:2781] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:01:08.659541 27068 raft_consensus.cc:686] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 LEADER]: Becoming Leader. State: Replica: 0365003bfb674fda8a3fd4f5ff14bf03, State: Running, Role: LEADER
I20260811 01:01:08.659619 27068 consensus_queue.cc:237] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.660044 26942 raft_consensus.cc:2454] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0365003bfb674fda8a3fd4f5ff14bf03 in term 1.
I20260811 01:01:08.660583 26177 catalog_manager.cc:5495] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0365003bfb674fda8a3fd4f5ff14bf03 (127.13.30.130). New cstate: current_term: 1 leader_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } health_report { overall_health: UNKNOWN } } }
I20260811 01:01:08.666428 27060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.663852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38996 (local address 127.13.30.130:37543)
0811 01:01:08.663920 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.663922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.663930 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:01:08.663960 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.663960 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.663978 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.664034 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:01:08.664198 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.664651 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.665741 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.665949 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.666015 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.666146 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:01:08.666253 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:01:08.666310 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.666344 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.666364 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 01:01:08.667460 26457 raft_consensus.cc:1261] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Refusing update from remote peer 0365003bfb674fda8a3fd4f5ff14bf03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:08.667603 26942 raft_consensus.cc:1261] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Refusing update from remote peer 0365003bfb674fda8a3fd4f5ff14bf03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:08.667757 27185 consensus_queue.cc:1035] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:08.667891 27068 consensus_queue.cc:1035] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:08.671703 26178 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:01:08.671826 26178 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:01:08.672497 26178 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d: Sending DeleteTablet for 3 replicas of tablet 455e8a0b715f4a29be5a5ad0a05924a6
I20260811 01:01:08.672762 26418 tablet_service.cc:1514] Processing DeleteTablet for tablet 455e8a0b715f4a29be5a5ad0a05924a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:08 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:47670
I20260811 01:01:08.672802 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet 455e8a0b715f4a29be5a5ad0a05924a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:08 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:51664
I20260811 01:01:08.672858 27114 tablet_replica.cc:330] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6: stopping tablet replica
I20260811 01:01:08.672894 27109 tablet_replica.cc:330] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068: stopping tablet replica
I20260811 01:01:08.672904 27114 raft_consensus.cc:2229] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:08.672941 27109 raft_consensus.cc:2229] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:08.672950 27114 raft_consensus.cc:2258] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:08.672992 27109 raft_consensus.cc:2258] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:08.673496 27109 ts_tablet_manager.cc:1905] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:08.673511 26659 tablet_service.cc:1514] Processing DeleteTablet for tablet 455e8a0b715f4a29be5a5ad0a05924a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:08 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:38990
I20260811 01:01:08.673611 27110 tablet_replica.cc:330] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03: stopping tablet replica
I20260811 01:01:08.673669 27110 raft_consensus.cc:2229] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:01:08.673756 27110 raft_consensus.cc:2258] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:08.673849 26178 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44898:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:01:08.674006 26178 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:01:08.675170 27109 ts_tablet_manager.cc:1918] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:01:08.675226 27109 log.cc:1196] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/455e8a0b715f4a29be5a5ad0a05924a6
I20260811 01:01:08.675390 26888 tablet_service.cc:1467] Processing CreateTablet for tablet cf31318906004ecfb7de6f64d8452a16 (DEFAULT_TABLE table=test-table [id=1f09e0acfcd840b5aeba686dc8a94bee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:08.675427 27109 ts_tablet_manager.cc:1939] T 455e8a0b715f4a29be5a5ad0a05924a6 P c209e007665c4f81909323290762f068: Deleting consensus metadata
I20260811 01:01:08.675513 26888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf31318906004ecfb7de6f64d8452a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.676115 26163 catalog_manager.cc:4841] TS c209e007665c4f81909323290762f068 (127.13.30.131:42019): tablet 455e8a0b715f4a29be5a5ad0a05924a6 (table test-table [id=6520ad2a1693486a86b7d0d9fbd30025]) successfully deleted
I20260811 01:01:08.676801 27069 tablet_bootstrap.cc:492] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068: Bootstrap starting.
I20260811 01:01:08.676826 26418 tablet_service.cc:1467] Processing CreateTablet for tablet cf31318906004ecfb7de6f64d8452a16 (DEFAULT_TABLE table=test-table [id=1f09e0acfcd840b5aeba686dc8a94bee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:08.676947 26418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf31318906004ecfb7de6f64d8452a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.677152 27069 tablet_bootstrap.cc:654] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.677910 27069 tablet_bootstrap.cc:492] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068: No bootstrap required, opened a new log
I20260811 01:01:08.677960 27069 ts_tablet_manager.cc:1397] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:08.678063 27069 raft_consensus.cc:348] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.678125 27069 raft_consensus.cc:374] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.678143 27069 raft_consensus.cc:729] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c209e007665c4f81909323290762f068, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.678182 27069 consensus_queue.cc:260] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.678259 27069 ts_tablet_manager.cc:1428] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:08.678380 27067 tablet_bootstrap.cc:492] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6: Bootstrap starting.
I20260811 01:01:08.679015 27067 tablet_bootstrap.cc:654] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.680106 26659 tablet_service.cc:1467] Processing CreateTablet for tablet cf31318906004ecfb7de6f64d8452a16 (DEFAULT_TABLE table=test-table [id=1f09e0acfcd840b5aeba686dc8a94bee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:08.680248 26659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf31318906004ecfb7de6f64d8452a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:08.681644 27063 tablet_bootstrap.cc:492] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03: Bootstrap starting.
I20260811 01:01:08.682101 27063 tablet_bootstrap.cc:654] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:08.682101 27067 tablet_bootstrap.cc:492] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6: No bootstrap required, opened a new log
I20260811 01:01:08.682154 27067 ts_tablet_manager.cc:1397] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 01:01:08.682329 27067 raft_consensus.cc:348] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.682416 27067 raft_consensus.cc:374] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.682436 27067 raft_consensus.cc:729] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e44b32235440a3ba881eb58c78d3f6, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.682484 27067 consensus_queue.cc:260] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.682582 27067 ts_tablet_manager.cc:1428] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:08.683323 27110 ts_tablet_manager.cc:1905] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:08.684813 27110 ts_tablet_manager.cc:1918] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:01:08.684882 27110 log.cc:1196] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/455e8a0b715f4a29be5a5ad0a05924a6
I20260811 01:01:08.685083 27110 ts_tablet_manager.cc:1939] T 455e8a0b715f4a29be5a5ad0a05924a6 P 0365003bfb674fda8a3fd4f5ff14bf03: Deleting consensus metadata
I20260811 01:01:08.685586 26162 catalog_manager.cc:4841] TS 0365003bfb674fda8a3fd4f5ff14bf03 (127.13.30.130:37543): tablet 455e8a0b715f4a29be5a5ad0a05924a6 (table test-table [id=6520ad2a1693486a86b7d0d9fbd30025]) successfully deleted
I20260811 01:01:08.685938 27114 ts_tablet_manager.cc:1905] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:08.686367 27063 tablet_bootstrap.cc:492] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03: No bootstrap required, opened a new log
I20260811 01:01:08.686429 27063 ts_tablet_manager.cc:1397] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 01:01:08.686587 27063 raft_consensus.cc:348] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.686662 27063 raft_consensus.cc:374] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:08.686681 27063 raft_consensus.cc:729] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0365003bfb674fda8a3fd4f5ff14bf03, State: Initialized, Role: FOLLOWER
I20260811 01:01:08.686728 27063 consensus_queue.cc:260] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.686831 27063 ts_tablet_manager.cc:1428] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:08.687490 27114 ts_tablet_manager.cc:1918] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:01:08.687562 27114 log.cc:1196] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-0/wal/wals/455e8a0b715f4a29be5a5ad0a05924a6
I20260811 01:01:08.687791 27114 ts_tablet_manager.cc:1939] T 455e8a0b715f4a29be5a5ad0a05924a6 P 00e44b32235440a3ba881eb58c78d3f6: Deleting consensus metadata
I20260811 01:01:08.688109 26161 catalog_manager.cc:4841] TS 00e44b32235440a3ba881eb58c78d3f6 (127.13.30.129:40001): tablet 455e8a0b715f4a29be5a5ad0a05924a6 (table test-table [id=6520ad2a1693486a86b7d0d9fbd30025]) successfully deleted
I20260811 01:01:08.791364 27081 raft_consensus.cc:482] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:01:08.791471 27081 raft_consensus.cc:504] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.791802 27081 leader_election.cc:288] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0365003bfb674fda8a3fd4f5ff14bf03 (127.13.30.130:37543), c209e007665c4f81909323290762f068 (127.13.30.131:42019)
I20260811 01:01:08.794931 27060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.792076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:45401 (local address 127.13.30.130:37543)
0811 01:01:08.792122 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.792124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.792265 (+ 141us) server_negotiation.cc:407] Connection header received
0811 01:01:08.792304 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.792305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.792315 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.792359 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:08.792544 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.793019 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.794225 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.794597 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.794656 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.794667 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.794818 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.794857 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 01:01:08.794942 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.792074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:58671 (local address 127.13.30.131:42019)
0811 01:01:08.792124 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.792126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.792272 (+ 146us) server_negotiation.cc:407] Connection header received
0811 01:01:08.792309 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.792310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.792319 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.792371 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:08.792554 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.793018 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.794230 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.794612 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.794678 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.794688 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.794824 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.794872 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 01:01:08.794957 27203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.792027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:42019 (local address 127.13.30.129:58671)
0811 01:01:08.792184 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.792195 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:08.792257 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:08.792381 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:08.792381 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:08.792383 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:08.792490 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.792492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.793121 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.793121 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.794136 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.794139 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.794688 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.794689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.794760 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.794763 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:01:08.794813 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 01:01:08.794856 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":48,"thread_start_us":89,"threads_started":1}
I20260811 01:01:08.794961 27205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.792015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:37543 (local address 127.13.30.129:45401)
0811 01:01:08.792178 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.792189 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:08.792255 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:08.792372 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:08.792373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:08.792374 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:08.792476 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.792478 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.793116 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.793117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.794136 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.794139 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.794675 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.794676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.794749 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.794753 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:01:08.794797 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 01:01:08.794845 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":31,"thread_start_us":84,"threads_started":1}
I20260811 01:01:08.795300 26942 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf31318906004ecfb7de6f64d8452a16" candidate_uuid: "00e44b32235440a3ba881eb58c78d3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c209e007665c4f81909323290762f068" is_pre_election: true
I20260811 01:01:08.795405 26942 raft_consensus.cc:2454] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e44b32235440a3ba881eb58c78d3f6 in term 0.
I20260811 01:01:08.795397 26689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf31318906004ecfb7de6f64d8452a16" candidate_uuid: "00e44b32235440a3ba881eb58c78d3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" is_pre_election: true
I20260811 01:01:08.795503 26689 raft_consensus.cc:2454] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e44b32235440a3ba881eb58c78d3f6 in term 0.
I20260811 01:01:08.795591 26351 leader_election.cc:302] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e44b32235440a3ba881eb58c78d3f6, c209e007665c4f81909323290762f068; no voters:
I20260811 01:01:08.795732 27081 raft_consensus.cc:2781] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:01:08.795771 27081 raft_consensus.cc:482] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:01:08.795792 27081 raft_consensus.cc:3037] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.796502 27081 raft_consensus.cc:504] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.796641 27081 leader_election.cc:288] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [CANDIDATE]: Term 1 election: Requested vote from peers 0365003bfb674fda8a3fd4f5ff14bf03 (127.13.30.130:37543), c209e007665c4f81909323290762f068 (127.13.30.131:42019)
I20260811 01:01:08.796831 26689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf31318906004ecfb7de6f64d8452a16" candidate_uuid: "00e44b32235440a3ba881eb58c78d3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0365003bfb674fda8a3fd4f5ff14bf03"
I20260811 01:01:08.796834 26942 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf31318906004ecfb7de6f64d8452a16" candidate_uuid: "00e44b32235440a3ba881eb58c78d3f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c209e007665c4f81909323290762f068"
I20260811 01:01:08.796911 26689 raft_consensus.cc:3037] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.796916 26942 raft_consensus.cc:3037] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:08.797606 26689 raft_consensus.cc:2454] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e44b32235440a3ba881eb58c78d3f6 in term 1.
I20260811 01:01:08.797691 26942 raft_consensus.cc:2454] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e44b32235440a3ba881eb58c78d3f6 in term 1.
I20260811 01:01:08.797808 26349 leader_election.cc:302] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e44b32235440a3ba881eb58c78d3f6, 0365003bfb674fda8a3fd4f5ff14bf03; no voters:
I20260811 01:01:08.797928 27081 raft_consensus.cc:2781] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:01:08.798084 27081 raft_consensus.cc:686] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 LEADER]: Becoming Leader. State: Replica: 00e44b32235440a3ba881eb58c78d3f6, State: Running, Role: LEADER
I20260811 01:01:08.798163 27081 consensus_queue.cc:237] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } }
I20260811 01:01:08.798897 26178 catalog_manager.cc:5495] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00e44b32235440a3ba881eb58c78d3f6 (127.13.30.129). New cstate: current_term: 1 leader_uuid: "00e44b32235440a3ba881eb58c78d3f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e44b32235440a3ba881eb58c78d3f6" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 } health_report { overall_health: UNKNOWN } } }
I20260811 01:01:08.807349 27057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.804791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47680 (local address 127.13.30.129:40001)
0811 01:01:08.804848 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.804850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.804860 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:01:08.804935 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.804936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.804956 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.805009 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:01:08.805094 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.805680 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.806637 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.806841 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.806891 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.807049 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:01:08.807149 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:01:08.807198 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.807254 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.807274 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 01:01:08.812337 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.810031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:57143 (local address 127.13.30.131:42019)
0811 01:01:08.810194 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.810196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.810204 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:01:08.810228 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.810229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.810239 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.810285 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:01:08.810423 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.810926 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.811686 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.811900 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.811955 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.812110 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:01:08.812144 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:01:08.812186 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.812240 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.812261 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260811 01:01:08.812383 27213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.809941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:42019 (local address 127.13.30.129:57143)
0811 01:01:08.810097 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.810110 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:08.810166 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:08.810287 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:08.810288 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:08.810289 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:01:08.810364 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.810365 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.810995 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.810996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.811605 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.811607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.811960 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.811961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.812027 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.812042 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:01:08.812193 (+ 151us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:01:08.812194 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 01:01:08.812230 (+ 36us) client_negotiation.cc:240] Negotiation successful
0811 01:01:08.812278 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":77,"threads_started":1}
I20260811 01:01:08.814639 26689 raft_consensus.cc:1261] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Refusing update from remote peer 00e44b32235440a3ba881eb58c78d3f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:08.814682 26942 raft_consensus.cc:1261] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Refusing update from remote peer 00e44b32235440a3ba881eb58c78d3f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:08.814904 27081 consensus_queue.cc:1035] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c209e007665c4f81909323290762f068" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:08.815064 27206 consensus_queue.cc:1035] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0365003bfb674fda8a3fd4f5ff14bf03" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:08.821731 27057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.819687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:57145 (local address 127.13.30.129:40001)
0811 01:01:08.819744 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:08.819745 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:08.819754 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:08.819774 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:08.819775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:08.819785 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:08.819835 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:01:08.819937 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.820389 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.821087 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.821261 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.821315 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.821490 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:01:08.821526 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:01:08.821578 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:08.821627 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 01:01:08.821652 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 01:01:08.821751 27149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.819522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40001 (local address 127.13.30.131:57145)
0811 01:01:08.819571 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.819583 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:08.819623 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:08.819839 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:08.819840 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:08.819842 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:01:08.819888 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.819889 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.820479 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.820480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.821027 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:08.821028 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:08.821326 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:08.821327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:08.821381 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:08.821388 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:01:08.821584 (+ 196us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:01:08.821586 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 01:01:08.821623 (+ 37us) client_negotiation.cc:240] Negotiation successful
0811 01:01:08.821669 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 01:01:08.828682 26178 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:01:08.828791 26178 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:01:08.829427 26178 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4e7883a42f704af399b242469fa0a81d: Sending DeleteTablet for 3 replicas of tablet cf31318906004ecfb7de6f64d8452a16
I20260811 01:01:08.829694 26418 tablet_service.cc:1514] Processing DeleteTablet for tablet cf31318906004ecfb7de6f64d8452a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:08 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:47670
I20260811 01:01:08.829706 26888 tablet_service.cc:1514] Processing DeleteTablet for tablet cf31318906004ecfb7de6f64d8452a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:08 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:51664
I20260811 01:01:08.829809 27109 tablet_replica.cc:330] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068: stopping tablet replica
I20260811 01:01:08.829802 26659 tablet_service.cc:1514] Processing DeleteTablet for tablet cf31318906004ecfb7de6f64d8452a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:08 UTC) from {username='oryx', principal='oryx/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:38990
I20260811 01:01:08.829860 27109 raft_consensus.cc:2229] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:08.829891 27109 raft_consensus.cc:2258] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:08.829882 27114 tablet_replica.cc:330] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6: stopping tablet replica
I20260811 01:01:08.829939 27114 raft_consensus.cc:2229] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:01:08.830032 27114 raft_consensus.cc:2258] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:08.830111 27110 tablet_replica.cc:330] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03: stopping tablet replica
I20260811 01:01:08.830175 27110 raft_consensus.cc:2229] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:08.830214 27110 raft_consensus.cc:2258] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:08.830336 27109 ts_tablet_manager.cc:1905] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:08.830686 27110 ts_tablet_manager.cc:1905] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:08.831875 27114 ts_tablet_manager.cc:1905] T cf31318906004ecfb7de6f64d8452a16 P 00e44b32235440a3ba881eb58c78d3f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:08.832195 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 26314
I20260811 01:01:08.837718 27110 ts_tablet_manager.cc:1918] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:01:08.837791 27110 log.cc:1196] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/cf31318906004ecfb7de6f64d8452a16
I20260811 01:01:08.837996 27110 ts_tablet_manager.cc:1939] T cf31318906004ecfb7de6f64d8452a16 P 0365003bfb674fda8a3fd4f5ff14bf03: Deleting consensus metadata
I20260811 01:01:08.838382 26162 catalog_manager.cc:4841] TS 0365003bfb674fda8a3fd4f5ff14bf03 (127.13.30.130:37543): tablet cf31318906004ecfb7de6f64d8452a16 (table test-table [id=1f09e0acfcd840b5aeba686dc8a94bee]) successfully deleted
I20260811 01:01:08.841642 27109 ts_tablet_manager.cc:1918] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:01:08.841720 27109 log.cc:1196] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/cf31318906004ecfb7de6f64d8452a16
I20260811 01:01:08.841908 27109 ts_tablet_manager.cc:1939] T cf31318906004ecfb7de6f64d8452a16 P c209e007665c4f81909323290762f068: Deleting consensus metadata
I20260811 01:01:08.842267 26163 catalog_manager.cc:4841] TS c209e007665c4f81909323290762f068 (127.13.30.131:42019): tablet cf31318906004ecfb7de6f64d8452a16 (table test-table [id=1f09e0acfcd840b5aeba686dc8a94bee]) successfully deleted
W20260811 01:01:08.842720 26161 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:40001 (error 108)
I20260811 01:01:08.843017 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 26550
I20260811 01:01:08.851519 27227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:08.843069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40001 (local address 127.0.0.1:47690)
0811 01:01:08.851350 (+ 8281us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:08.851455 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:40001: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":8248,"thread_start_us":37,"threads_started":1}
W20260811 01:01:08.851676 26161 catalog_manager.cc:4584] TS 00e44b32235440a3ba881eb58c78d3f6 (127.13.30.129:40001): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cf31318906004ecfb7de6f64d8452a16: Network error: Client connection negotiation failed: client connection to 127.13.30.129:40001: connect: Connection refused (error 111)
I20260811 01:01:08.861799 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 26785
I20260811 01:01:08.885057 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 26137
2026-08-11T01:01:08Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2915 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:01:08 dist-test-slave-42z9 krb5kdc[27236](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:01:08 dist-test-slave-42z9 krb5kdc[27236](info): set up 2 sockets
Aug 11 01:01:08 dist-test-slave-42z9 krb5kdc[27236](info): commencing operation
krb5kdc: starting...
W20260811 01:01:10.088909 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:01:10 dist-test-slave-42z9 krb5kdc[27236](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:01:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:01:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:01:10.236848 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:40355
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:44853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:40355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:10.334537 27254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:10.334789 27254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:10.334825 27254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:10.336162 27254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:01:10.336225 27254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:10.336243 27254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:10.336259 27254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:01:10.336275 27254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:01:10.338124 27254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:44853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:40355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:40355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:10.338447 27254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:10.338694 27254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:10.344161 27266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:10.344198 27254 server_base.cc:1034] running on GCE node
W20260811 01:01:10.344179 27268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:10.344203 27264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:10.344704 27254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:10.345041 27254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:10.346311 27254 hybrid_clock.cc:648] HybridClock initialized: now 1786410070346277 us; error 31 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T01:01:10Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1456 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:01:10 dist-test-slave-42z9 krb5kdc[27273](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:01:10 dist-test-slave-42z9 krb5kdc[27273](info): set up 2 sockets
Aug 11 01:01:10 dist-test-slave-42z9 krb5kdc[27273](info): commencing operation
krb5kdc: starting...
W20260811 01:01:11.534595 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:01:11 dist-test-slave-42z9 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:01:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:01:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:01:11.660530 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:41827
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:41827
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:11.748730 27292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:11.748992 27292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:11.749038 27292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:11.750537 27292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:01:11.750610 27292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:11.750630 27292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:11.750648 27292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:01:11.750663 27292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:01:11.752462 27292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:41827
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:41827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:11.752756 27292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:11.753003 27292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:11.758057 27304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:11.758057 27302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:11.758073 27307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:11.758320 27292 server_base.cc:1034] running on GCE node
I20260811 01:01:11.758620 27292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:11.758929 27292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:11.760079 27292 hybrid_clock.cc:648] HybridClock initialized: now 1786410071760057 us; error 34 us; skew 500 ppm
Aug 11 01:01:11 dist-test-slave-42z9 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410071, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:11.767536 27292 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:01:11.768049 27292 webserver.cc:460] Webserver started at http://127.13.30.190:33407/ using document root <none> and password file <none>
I20260811 01:01:11.768278 27292 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:11.768334 27292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:11.768486 27292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:11.769701 27292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "82800eb7599a4165b22e727d6a394c21"
format_stamp: "Formatted at 2026-08-11 01:01:11 on dist-test-slave-42z9"
server_key: "c9a1a2b5e7140b919b59fde74ecc49ca"
server_key_iv: "8ae5f2a6c8dd1debed424ef694822db0"
server_key_version: "encryptionkey@0"
I20260811 01:01:11.770071 27292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "82800eb7599a4165b22e727d6a394c21"
format_stamp: "Formatted at 2026-08-11 01:01:11 on dist-test-slave-42z9"
server_key: "c9a1a2b5e7140b919b59fde74ecc49ca"
server_key_iv: "8ae5f2a6c8dd1debed424ef694822db0"
server_key_version: "encryptionkey@0"
I20260811 01:01:11.771988 27292 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 01:01:11.772857 27319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:11.773052 27292 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:11.773147 27292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "82800eb7599a4165b22e727d6a394c21"
format_stamp: "Formatted at 2026-08-11 01:01:11 on dist-test-slave-42z9"
server_key: "c9a1a2b5e7140b919b59fde74ecc49ca"
server_key_iv: "8ae5f2a6c8dd1debed424ef694822db0"
server_key_version: "encryptionkey@0"
I20260811 01:01:11.773219 27292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:11.787858 27292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:11.789812 27292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:11.789955 27292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:11.794062 27292 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:41827
I20260811 01:01:11.794106 27410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:41827 every 8 connection(s)
I20260811 01:01:11.794459 27292 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:01:11.795331 27412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:11.796798 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 27292
I20260811 01:01:11.796922 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:01:11.797111 13434 external_mini_cluster.cc:1428] Setting key e38b889fcd3e21bbb173d7cd64e663e0
I20260811 01:01:11.798012 27412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21: Bootstrap starting.
I20260811 01:01:11.798669 27412 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:11.799005 27412 log.cc:824] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:11.799788 27412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21: No bootstrap required, opened a new log
I20260811 01:01:11.801985 27412 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82800eb7599a4165b22e727d6a394c21" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41827 } }
I20260811 01:01:11.802187 27412 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:11.802227 27412 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82800eb7599a4165b22e727d6a394c21, State: Initialized, Role: FOLLOWER
I20260811 01:01:11.802656 27412 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82800eb7599a4165b22e727d6a394c21" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41827 } }
I20260811 01:01:11.802763 27412 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:01:11.802803 27412 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:01:11.802865 27412 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:11.803642 27412 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82800eb7599a4165b22e727d6a394c21" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41827 } }
I20260811 01:01:11.803745 27412 leader_election.cc:302] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82800eb7599a4165b22e727d6a394c21; no voters:
I20260811 01:01:11.803932 27412 leader_election.cc:288] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:01:11.803979 27422 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:01:11.804100 27422 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 1 LEADER]: Becoming Leader. State: Replica: 82800eb7599a4165b22e727d6a394c21, State: Running, Role: LEADER
I20260811 01:01:11.804183 27422 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82800eb7599a4165b22e727d6a394c21" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41827 } }
Aug 11 01:01:11 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:01:11.804227 27412 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:01:11.804718 27422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82800eb7599a4165b22e727d6a394c21. Latest consensus state: current_term: 1 leader_uuid: "82800eb7599a4165b22e727d6a394c21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82800eb7599a4165b22e727d6a394c21" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41827 } } }
I20260811 01:01:11.804765 27425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82800eb7599a4165b22e727d6a394c21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82800eb7599a4165b22e727d6a394c21" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41827 } } }
I20260811 01:01:11.804812 27422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:11.804842 27425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:11.805045 27433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:01:11.805827 27433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:01:11.807427 27433 catalog_manager.cc:1347] Generated new cluster ID: 1d6ccf7e11254b048875506e400c2052
I20260811 01:01:11.807473 27433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:01:11.808830 27420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:11.797677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58064 (local address 127.13.30.190:41827)
0811 01:01:11.797840 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:11.797848 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:11.797874 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:01:11.798346 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:11.798354 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:11.798401 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:11.798516 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:11.799277 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:11.800287 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:11.801337 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:11.801932 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:11.802029 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:11.804795 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:11.804811 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:11.804811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:11.804825 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:11.806748 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:11.807162 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:11.807166 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:11.807166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:11.807267 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:11.807477 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:11.807478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:11.807478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:11.807783 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:11.807917 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:11.808485 (+ 568us) server_negotiation.cc:299] Negotiation successful
0811 01:01:11.808632 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260811 01:01:11.841965 27433 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:01:11.842571 27433 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:01:11.849188 27433 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21: Generated new TSK 0
I20260811 01:01:11.849393 27433 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:01:11.893601 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41827
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:12.000952 27454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:12.001175 27454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:12.001200 27454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:12.002501 27454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:12.002553 27454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:12.002585 27454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:01:12.004171 27454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:12.004424 27454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:12.004683 27454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:12.009970 27460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:12.009974 27462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:12.010258 27454 server_base.cc:1034] running on GCE node
W20260811 01:01:12.009999 27459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:12.010531 27454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:12.010780 27454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:12.011977 27454 hybrid_clock.cc:648] HybridClock initialized: now 1786410072011962 us; error 33 us; skew 500 ppm
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410072, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:12.014621 27454 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:01:12.015090 27454 webserver.cc:460] Webserver started at http://127.13.30.129:42955/ using document root <none> and password file <none>
I20260811 01:01:12.015308 27454 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:12.015348 27454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:12.015448 27454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:12.016505 27454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "3bc8870f5a324b06975a4543bee4d09e"
format_stamp: "Formatted at 2026-08-11 01:01:12 on dist-test-slave-42z9"
server_key: "9a6daedfe939dd41e0fddb0bae1d2e28"
server_key_iv: "7a9780b3067d92ead999eb01c16538b4"
server_key_version: "encryptionkey@0"
I20260811 01:01:12.016825 27454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "3bc8870f5a324b06975a4543bee4d09e"
format_stamp: "Formatted at 2026-08-11 01:01:12 on dist-test-slave-42z9"
server_key: "9a6daedfe939dd41e0fddb0bae1d2e28"
server_key_iv: "7a9780b3067d92ead999eb01c16538b4"
server_key_version: "encryptionkey@0"
I20260811 01:01:12.018206 27454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:01:12.018949 27471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.019132 27454 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:01:12.019212 27454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "3bc8870f5a324b06975a4543bee4d09e"
format_stamp: "Formatted at 2026-08-11 01:01:12 on dist-test-slave-42z9"
server_key: "9a6daedfe939dd41e0fddb0bae1d2e28"
server_key_iv: "7a9780b3067d92ead999eb01c16538b4"
server_key_version: "encryptionkey@0"
I20260811 01:01:12.019275 27454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:12.029569 27454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:12.031637 27454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:12.031766 27454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:12.031975 27454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:12.032254 27454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:12.032285 27454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.032307 27454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:12.032323 27454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.038213 27454 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:38673
I20260811 01:01:12.038257 27672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:38673 every 8 connection(s)
I20260811 01:01:12.038597 27454 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:01:12.040835 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 27454
I20260811 01:01:12.040956 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:01:12.041162 13434 external_mini_cluster.cc:1428] Setting key b04784f5c313f76bcad7f12184370402
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410072, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:01:12.049856 27420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:12.039330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:40155 (local address 127.13.30.190:41827)
0811 01:01:12.039383 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:12.039385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:12.039613 (+ 228us) server_negotiation.cc:407] Connection header received
0811 01:01:12.040138 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:12.040139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:12.040153 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:12.040208 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:12.041499 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.042095 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.043540 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.043818 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.043878 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.046758 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:12.046761 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:12.046761 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:12.046770 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:12.048202 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:12.048755 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:12.048756 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:12.048756 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:12.048820 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:12.049108 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:12.049109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:12.049109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:12.049225 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:12.049272 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:12.049672 (+ 400us) server_negotiation.cc:299] Negotiation successful
0811 01:01:12.049769 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 01:01:12.050185 27677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:12.039300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:40155)
0811 01:01:12.039487 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:12.039526 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:12.040035 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:12.040295 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:12.040300 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:12.041045 (+ 745us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:12.041347 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.041355 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.042190 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.042191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.043402 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.043407 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.043912 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.043913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.044074 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.044717 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:12.044729 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:12.046622 (+ 1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:12.048300 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:12.048311 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:12.048314 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:12.048679 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:12.048884 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:12.048885 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:12.048885 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:12.049044 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:12.049283 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:12.049290 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:12.049522 (+ 232us) client_negotiation.cc:769] Sending connection context
0811 01:01:12.049650 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 01:01:12.049853 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":73,"threads_started":1}
I20260811 01:01:12.050735 27673 heartbeater.cc:347] Connected to a master server at 127.13.30.190:41827
I20260811 01:01:12.050858 27673 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:12.051054 27673 heartbeater.cc:511] Master 127.13.30.190:41827 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
I20260811 01:01:12.051689 27346 ts_manager.cc:194] Registered new tserver with Master: 3bc8870f5a324b06975a4543bee4d09e (127.13.30.129:38673)
I20260811 01:01:12.052357 27346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:40155
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:01:12.071920 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41827
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:12.158229 27680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:12.158458 27680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:12.158494 27680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:12.159812 27680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:12.159878 27680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:12.159917 27680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:01:12.161641 27680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:12.161922 27680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:12.162168 27680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:12.167322 27692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:12.167477 27697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:12.167318 27691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:12.167496 27680 server_base.cc:1034] running on GCE node
I20260811 01:01:12.167798 27680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:12.168054 27680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:12.169227 27680 hybrid_clock.cc:648] HybridClock initialized: now 1786410072169208 us; error 35 us; skew 500 ppm
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410072, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:12.171981 27680 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:01:12.172493 27680 webserver.cc:460] Webserver started at http://127.13.30.130:39125/ using document root <none> and password file <none>
I20260811 01:01:12.172749 27680 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:12.172802 27680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:12.172930 27680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:12.174122 27680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "e53c4a6984ca4699a29043500c5d5c34"
format_stamp: "Formatted at 2026-08-11 01:01:12 on dist-test-slave-42z9"
server_key: "179e3fb6ac02071d8a0ba548bc04f506"
server_key_iv: "152e905686e03fdd870bc9b5fc32e808"
server_key_version: "encryptionkey@0"
I20260811 01:01:12.174481 27680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "e53c4a6984ca4699a29043500c5d5c34"
format_stamp: "Formatted at 2026-08-11 01:01:12 on dist-test-slave-42z9"
server_key: "179e3fb6ac02071d8a0ba548bc04f506"
server_key_iv: "152e905686e03fdd870bc9b5fc32e808"
server_key_version: "encryptionkey@0"
I20260811 01:01:12.175808 27680 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 01:01:12.176576 27706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.176754 27680 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 01:01:12.176846 27680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "e53c4a6984ca4699a29043500c5d5c34"
format_stamp: "Formatted at 2026-08-11 01:01:12 on dist-test-slave-42z9"
server_key: "179e3fb6ac02071d8a0ba548bc04f506"
server_key_iv: "152e905686e03fdd870bc9b5fc32e808"
server_key_version: "encryptionkey@0"
I20260811 01:01:12.176905 27680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:12.193369 27680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:12.195672 27680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:12.195799 27680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:12.196033 27680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:12.196326 27680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:12.196362 27680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.196384 27680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:12.196395 27680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.202061 27680 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:37921
I20260811 01:01:12.202139 27902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:37921 every 8 connection(s)
I20260811 01:01:12.202430 27680 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:01:12.208220 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 27680
I20260811 01:01:12.208384 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:01:12.208598 13434 external_mini_cluster.cc:1428] Setting key 3db4159c86282d37a0218f62962edf2c
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410072, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:01:12.212819 27420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:12.203164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:57267 (local address 127.13.30.190:41827)
0811 01:01:12.203210 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:12.203211 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:12.203439 (+ 228us) server_negotiation.cc:407] Connection header received
0811 01:01:12.203936 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:12.203937 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:12.203948 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:12.204030 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:12.205092 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.205662 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.206694 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.206895 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.206951 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.209524 (+ 2573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:12.209526 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:12.209527 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:12.209535 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:12.210791 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:12.211387 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:12.211391 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:12.211392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:12.211620 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:12.212070 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:12.212072 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:12.212073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:12.212272 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:12.212349 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:12.212612 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 01:01:12.212717 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 01:01:12.212949 27906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:12.203130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:57267)
0811 01:01:12.203293 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:12.203339 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:12.203839 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:12.204153 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:12.204157 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:12.204757 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:12.204984 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.204990 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.205758 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.205759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.206612 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.206615 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.206963 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.206964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.207066 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.207605 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:12.207614 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:12.209395 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:12.210881 (+ 1486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:12.210893 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:12.210896 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:12.211238 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:12.211849 (+ 611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:12.211850 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:12.211850 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:12.211997 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:12.212336 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:12.212340 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:12.212486 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 01:01:12.212574 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 01:01:12.212728 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
I20260811 01:01:12.213485 27903 heartbeater.cc:347] Connected to a master server at 127.13.30.190:41827
I20260811 01:01:12.213603 27903 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:12.213817 27903 heartbeater.cc:511] Master 127.13.30.190:41827 requested a full tablet report, sending...
I20260811 01:01:12.214234 27346 ts_manager.cc:194] Registered new tserver with Master: e53c4a6984ca4699a29043500c5d5c34 (127.13.30.130:37921)
I20260811 01:01:12.214612 27346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:57267
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:01:12.241534 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41827
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:12.328935 27912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:12.329150 27912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:12.329173 27912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:12.330411 27912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:12.330458 27912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:12.330485 27912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:01:12.331967 27912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:41827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:12.332197 27912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:12.332458 27912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:12.337630 27928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:12.337630 27926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:12.337699 27925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:12.337661 27912 server_base.cc:1034] running on GCE node
I20260811 01:01:12.338073 27912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:12.338332 27912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:12.339478 27912 hybrid_clock.cc:648] HybridClock initialized: now 1786410072339461 us; error 37 us; skew 500 ppm
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410072, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:12.342073 27912 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:01:12.342496 27912 webserver.cc:460] Webserver started at http://127.13.30.131:43959/ using document root <none> and password file <none>
I20260811 01:01:12.342710 27912 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:12.342748 27912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:12.342854 27912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:12.343883 27912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "7f0ff0878261408f81b928ef698faa69"
format_stamp: "Formatted at 2026-08-11 01:01:12 on dist-test-slave-42z9"
server_key: "575806dbb8ec006eaece4936d4601c8b"
server_key_iv: "54c8b097e1b9b1e52521a9548c68d119"
server_key_version: "encryptionkey@0"
I20260811 01:01:12.344180 27912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "7f0ff0878261408f81b928ef698faa69"
format_stamp: "Formatted at 2026-08-11 01:01:12 on dist-test-slave-42z9"
server_key: "575806dbb8ec006eaece4936d4601c8b"
server_key_iv: "54c8b097e1b9b1e52521a9548c68d119"
server_key_version: "encryptionkey@0"
I20260811 01:01:12.345433 27912 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:01:12.346199 27940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.346360 27912 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:12.346447 27912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "7f0ff0878261408f81b928ef698faa69"
format_stamp: "Formatted at 2026-08-11 01:01:12 on dist-test-slave-42z9"
server_key: "575806dbb8ec006eaece4936d4601c8b"
server_key_iv: "54c8b097e1b9b1e52521a9548c68d119"
server_key_version: "encryptionkey@0"
I20260811 01:01:12.346511 27912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:12.358856 27912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:12.361137 27912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:12.361267 27912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:12.361538 27912 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:12.361850 27912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:12.361881 27912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.361912 27912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:12.361927 27912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.367776 27912 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:43791
I20260811 01:01:12.367846 28139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:43791 every 8 connection(s)
I20260811 01:01:12.368170 27912 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:01:12.368589 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 27912
I20260811 01:01:12.368697 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:01:12.368880 13434 external_mini_cluster.cc:1428] Setting key 7d722cf192c62a4484e4631cfe4a36a1
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410072, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:01:12.378351 27420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:12.369087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:40941 (local address 127.13.30.190:41827)
0811 01:01:12.369150 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:12.369152 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:12.369406 (+ 254us) server_negotiation.cc:407] Connection header received
0811 01:01:12.370046 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:12.370047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:12.370057 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:12.370099 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:12.371112 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.371627 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.372690 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.372891 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.372957 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.375486 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:12.375488 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:12.375488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:12.375497 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:12.376888 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:12.377411 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:12.377413 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:12.377413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:12.377496 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:12.377744 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:12.377744 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:12.377745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:12.377876 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:12.377942 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:12.378193 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 01:01:12.378273 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 01:01:12.378602 28143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:12.369088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:40941)
0811 01:01:12.369256 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:12.369302 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:12.369959 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:12.370159 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:12.370163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:12.370780 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:12.370996 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.371001 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.371723 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.371724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.372580 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.372583 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.372975 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.372976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.373089 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.373756 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:12.373765 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:12.375351 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:12.377022 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:12.377031 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:12.377033 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:12.377323 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:12.377556 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:12.377558 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:12.377558 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:12.377686 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:12.377932 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:12.377936 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:12.378083 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 01:01:12.378173 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 01:01:12.378331 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":93,"threads_started":1}
I20260811 01:01:12.379272 28141 heartbeater.cc:347] Connected to a master server at 127.13.30.190:41827
I20260811 01:01:12.379390 28141 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:12.379591 28141 heartbeater.cc:511] Master 127.13.30.190:41827 requested a full tablet report, sending...
I20260811 01:01:12.380026 27346 ts_manager.cc:194] Registered new tserver with Master: 7f0ff0878261408f81b928ef698faa69 (127.13.30.131:43791)
I20260811 01:01:12.380527 27346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:40941
I20260811 01:01:12.381595 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.129.keytab.
Entry for principal oryx/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.129.keytab.
WARNING: no policy specified for oryx/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.130.keytab.
Entry for principal oryx/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.130.keytab.
WARNING: no policy specified for oryx/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.131.keytab.
Entry for principal oryx/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.131.keytab.
I20260811 01:01:12.468379 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 27454
I20260811 01:01:12.484292 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 27680
I20260811 01:01:12.495158 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 27912
I20260811 01:01:12.517704 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 27292
I20260811 01:01:12.535975 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:41827
--webserver_interface=127.13.30.190
--webserver_port=33407
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:41827
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:12.622973 28153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:12.623214 28153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:12.623239 28153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:12.624480 28153 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:01:12.624531 28153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:12.624545 28153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:12.624557 28153 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:01:12.624567 28153 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:01:12.626150 28153 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:41827
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:41827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=33407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:12.626380 28153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:12.626579 28153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:12.631742 28167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:12.631953 28153 server_base.cc:1034] running on GCE node
W20260811 01:01:12.631757 28176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:12.631765 28172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:12.632356 28153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:12.632685 28153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:12.633828 28153 hybrid_clock.cc:648] HybridClock initialized: now 1786410072633820 us; error 38 us; skew 500 ppm
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410072, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:12.636453 28153 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:01:12.636936 28153 webserver.cc:460] Webserver started at http://127.13.30.190:33407/ using document root <none> and password file <none>
I20260811 01:01:12.637151 28153 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:12.637221 28153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:12.638652 28153 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:12.639320 28191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.639489 28153 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:12.639577 28153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "82800eb7599a4165b22e727d6a394c21"
format_stamp: "Formatted at 2026-08-11 01:01:11 on dist-test-slave-42z9"
server_key: "c9a1a2b5e7140b919b59fde74ecc49ca"
server_key_iv: "8ae5f2a6c8dd1debed424ef694822db0"
server_key_version: "encryptionkey@0"
I20260811 01:01:12.639941 28153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:12.646610 28153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:12.648360 28153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:12.648495 28153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:12.652463 28153 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:41827
I20260811 01:01:12.652508 28284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:41827 every 8 connection(s)
I20260811 01:01:12.652879 28153 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:01:12.654371 28285 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:01:12.655046 28285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21: Bootstrap starting.
I20260811 01:01:12.662078 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 28153
I20260811 01:01:12.662380 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:38673
--local_ip_for_outbound_sockets=127.13.30.129
--tserver_master_addrs=127.13.30.190:41827
--webserver_port=42955
--webserver_interface=127.13.30.129
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.13.30.129
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.129.keytab with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:01:12.663794 28285 log.cc:824] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:12.665550 28285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:01:12.665802 28285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21: Bootstrap complete.
I20260811 01:01:12.668057 28285 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82800eb7599a4165b22e727d6a394c21" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41827 } }
I20260811 01:01:12.668299 28285 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82800eb7599a4165b22e727d6a394c21, State: Initialized, Role: FOLLOWER
I20260811 01:01:12.668462 28285 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82800eb7599a4165b22e727d6a394c21" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41827 } }
I20260811 01:01:12.668540 28285 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:01:12.668593 28285 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:01:12.668642 28285 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:01:12.669747 28285 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82800eb7599a4165b22e727d6a394c21" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41827 } }
I20260811 01:01:12.669857 28285 leader_election.cc:302] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82800eb7599a4165b22e727d6a394c21; no voters:
I20260811 01:01:12.670035 28285 leader_election.cc:288] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 01:01:12.670078 28293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:01:12.670193 28293 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [term 2 LEADER]: Becoming Leader. State: Replica: 82800eb7599a4165b22e727d6a394c21, State: Running, Role: LEADER
I20260811 01:01:12.670338 28285 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:01:12.670359 28293 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82800eb7599a4165b22e727d6a394c21" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41827 } }
I20260811 01:01:12.670720 28295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82800eb7599a4165b22e727d6a394c21. Latest consensus state: current_term: 2 leader_uuid: "82800eb7599a4165b22e727d6a394c21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82800eb7599a4165b22e727d6a394c21" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41827 } } }
I20260811 01:01:12.670727 28294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "82800eb7599a4165b22e727d6a394c21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82800eb7599a4165b22e727d6a394c21" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41827 } } }
I20260811 01:01:12.670871 28295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:12.670879 28294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:12.672333 28321 catalog_manager.cc:1259] Loaded cluster ID: 1d6ccf7e11254b048875506e400c2052
I20260811 01:01:12.672384 28321 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21: loading cluster ID for follower catalog manager: success
I20260811 01:01:12.673575 28321 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21: acquiring CA information for follower catalog manager: success
I20260811 01:01:12.673925 28321 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:01:12.674007 28304 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:01:12.674192 28304 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:01:12.674254 28304 catalog_manager.cc:1259] Loaded cluster ID: 1d6ccf7e11254b048875506e400c2052
I20260811 01:01:12.674281 28304 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:01:12.674439 28304 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:01:12.674520 28304 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 82800eb7599a4165b22e727d6a394c21: Loaded TSK: 0
I20260811 01:01:12.674650 28304 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:01:12.750432 28289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:12.750669 28289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:12.750703 28289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:12.751942 28289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:12.751987 28289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:12.752025 28289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:01:12.753690 28289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.129.keytab
--principal=oryx/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:38673
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=42955
--tserver_master_addrs=127.13.30.190:41827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:12.753959 28289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:12.754194 28289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:12.759527 28328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:12.759685 28289 server_base.cc:1034] running on GCE node
W20260811 01:01:12.759516 28336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:12.759714 28332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:12.760032 28289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:12.760299 28289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:12.761497 28289 hybrid_clock.cc:648] HybridClock initialized: now 1786410072761452 us; error 57 us; skew 500 ppm
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410072, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:12.764201 28289 init.cc:377] Logged in from keytab as oryx/127.13.30.129@KRBTEST.COM (short username oryx)
I20260811 01:01:12.764668 28289 webserver.cc:460] Webserver started at http://127.13.30.129:42955/ using document root <none> and password file <none>
I20260811 01:01:12.764904 28289 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:12.764986 28289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:12.766470 28289 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:12.767236 28344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.767452 28289 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:12.767546 28289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "3bc8870f5a324b06975a4543bee4d09e"
format_stamp: "Formatted at 2026-08-11 01:01:12 on dist-test-slave-42z9"
server_key: "9a6daedfe939dd41e0fddb0bae1d2e28"
server_key_iv: "7a9780b3067d92ead999eb01c16538b4"
server_key_version: "encryptionkey@0"
I20260811 01:01:12.767925 28289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:12.783821 28289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:12.786366 28289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:12.786556 28289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:12.786810 28289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:12.787159 28289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:12.787199 28289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.787230 28289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:12.787253 28289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.794214 28289 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:38673
I20260811 01:01:12.794282 28547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:38673 every 8 connection(s)
I20260811 01:01:12.794658 28289 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:01:12.798636 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 28289
I20260811 01:01:12.798991 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:37921
--local_ip_for_outbound_sockets=127.13.30.130
--tserver_master_addrs=127.13.30.190:41827
--webserver_port=39125
--webserver_interface=127.13.30.130
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.13.30.130
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.130.keytab with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:12.804979 28552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:12.795431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:45955)
0811 01:01:12.795617 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:12.795851 (+ 234us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:12.796534 (+ 683us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:12.796982 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:12.796986 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:12.797806 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:12.798092 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.798100 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.799502 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.799504 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.800346 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.800349 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.801110 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.801112 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.801271 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.801901 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:12.801910 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:12.804747 (+ 2837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
W20260811 01:01:12.805160 28553 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:12.795578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:45955 (local address 127.13.30.190:41827)
0811 01:01:12.795794 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:12.795804 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:12.795965 (+ 161us) server_negotiation.cc:407] Connection header received
0811 01:01:12.796737 (+ 772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:12.796743 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:12.796787 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:12.796898 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:12.798250 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.799385 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.800440 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.800993 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.801110 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.804960 (+ 3850us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:45955: BlockingRecv error: recv got EOF from 127.13.30.129:45955 (error 108)
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":84,"threads_started":1}
W20260811 01:01:12.805646 28549 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:41827 (0 consecutive failures): Not authorized: Failed to ping master at 127.13.30.190:41827: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:12.811278 28552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:12.805919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:56615)
0811 01:01:12.805970 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:12.805980 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:12.806025 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:12.806200 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:12.806201 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:12.806367 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:12.806435 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.806437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.807393 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.807395 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.808099 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.808102 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.808566 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.808567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.808638 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.809149 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:12.809154 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:12.811219 (+ 2065us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 01:01:12.811417 28553 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:12.805973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:56615 (local address 127.13.30.190:41827)
0811 01:01:12.806015 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:12.806017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:12.806028 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:01:12.806109 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:12.806110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:12.806127 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:12.806184 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:12.806530 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.807270 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.808187 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.808487 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.808562 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.811349 (+ 2787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:56615: BlockingRecv error: recv got EOF from 127.13.30.129:56615 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:12.816253 28552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:12.811552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:53433)
0811 01:01:12.811595 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:12.811604 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:12.811637 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:12.811769 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:12.811769 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:12.811897 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:12.811934 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.811936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.812834 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.812835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.813411 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.813415 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.813820 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.813821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.813882 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.814312 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:12.814316 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:12.816176 (+ 1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 01:01:12.816433 28549 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:01:12.816553 28553 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:12.811595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:53433 (local address 127.13.30.190:41827)
0811 01:01:12.811628 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:12.811630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:12.811639 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:12.811689 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:12.811690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:12.811701 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:12.811751 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:12.811989 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.812755 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.813560 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.813755 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.813816 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.816292 (+ 2476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:53433: BlockingRecv error: recv got EOF from 127.13.30.129:53433 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260811 01:01:12.891062 28554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:12.891299 28554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:12.891336 28554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:12.892614 28554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:12.892658 28554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:12.892699 28554 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:01:12.894373 28554 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.130.keytab
--principal=oryx/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:37921
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=39125
--tserver_master_addrs=127.13.30.190:41827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:12.894660 28554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:12.894907 28554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:12.901126 28564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:12.901257 28560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:12.901124 28562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:12.901497 28554 server_base.cc:1034] running on GCE node
I20260811 01:01:12.901711 28554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:12.901947 28554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:12.903091 28554 hybrid_clock.cc:648] HybridClock initialized: now 1786410072903077 us; error 28 us; skew 500 ppm
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410072, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:12.906065 28554 init.cc:377] Logged in from keytab as oryx/127.13.30.130@KRBTEST.COM (short username oryx)
I20260811 01:01:12.906831 28554 webserver.cc:460] Webserver started at http://127.13.30.130:39125/ using document root <none> and password file <none>
I20260811 01:01:12.907119 28554 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:12.907198 28554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:12.909135 28554 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:01:12.909927 28581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.910106 28554 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 01:01:12.910205 28554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "e53c4a6984ca4699a29043500c5d5c34"
format_stamp: "Formatted at 2026-08-11 01:01:12 on dist-test-slave-42z9"
server_key: "179e3fb6ac02071d8a0ba548bc04f506"
server_key_iv: "152e905686e03fdd870bc9b5fc32e808"
server_key_version: "encryptionkey@0"
I20260811 01:01:12.910624 28554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:12.928460 28554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:12.930925 28554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:12.931087 28554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:12.931354 28554 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:12.931694 28554 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:12.931727 28554 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.931751 28554 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:12.931764 28554 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:12.939157 28554 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:37921
I20260811 01:01:12.939216 28784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:37921 every 8 connection(s)
I20260811 01:01:12.939618 28554 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:12.947463 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 28554
W20260811 01:01:12.947621 28553 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:12.940412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:42823 (local address 127.13.30.190:41827)
0811 01:01:12.940459 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:12.940461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:12.940700 (+ 239us) server_negotiation.cc:407] Connection header received
0811 01:01:12.941235 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:12.941237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:12.941254 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:12.941309 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:12.942382 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.942888 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.943949 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.944147 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.944205 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.947560 (+ 3355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:42823: BlockingRecv error: recv got EOF from 127.13.30.130:42823 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 01:01:12.947670 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:12.940396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:42823)
0811 01:01:12.940578 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:12.940614 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:12.941132 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:12.941395 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:12.941398 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:12.942060 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:12.942286 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.942292 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.942982 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.942984 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.943856 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.943859 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.944223 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.944224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.944350 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.944864 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:12.944873 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:12.947442 (+ 2569us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":91,"threads_started":1}
I20260811 01:01:12.947777 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:43791
--local_ip_for_outbound_sockets=127.13.30.131
--tserver_master_addrs=127.13.30.190:41827
--webserver_port=43959
--webserver_interface=127.13.30.131
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.13.30.131
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.131.keytab with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:12.948163 28785 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:41827 (0 consecutive failures): Not authorized: Failed to ping master at 127.13.30.190:41827: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:12.952914 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:12.948386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:60183)
0811 01:01:12.948516 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:12.948528 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:12.948593 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:12.948724 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:12.948725 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:12.948898 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:12.948964 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.948966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.949708 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.949709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.950220 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.950222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.950556 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.950557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.950623 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.951038 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:12.951043 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:12.952820 (+ 1777us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109}
W20260811 01:01:12.952975 28553 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:12.948464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:60183 (local address 127.13.30.190:41827)
0811 01:01:12.948520 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:12.948522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:12.948574 (+ 52us) server_negotiation.cc:407] Connection header received
0811 01:01:12.948655 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:12.948656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:12.948664 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:12.948705 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:12.949092 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.949627 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.950296 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.950495 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.950550 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.952920 (+ 2370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:60183: BlockingRecv error: recv got EOF from 127.13.30.130:60183 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:12 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:12.958391 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:12.953213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:46005)
0811 01:01:12.953365 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:12.953376 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:12.953430 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:12.953604 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:12.953605 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:12.953754 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:12.953800 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.953802 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.954431 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.954432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.955209 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:12.955212 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.955620 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.955621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:12.955680 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.956113 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:12.956118 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:12.958310 (+ 2192us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":98,"threads_started":1}
W20260811 01:01:12.958536 28553 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:12.953273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:46005 (local address 127.13.30.190:41827)
0811 01:01:12.953309 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:12.953311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:12.953422 (+ 111us) server_negotiation.cc:407] Connection header received
0811 01:01:12.953523 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:12.953524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:12.953532 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:12.953580 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:12.953880 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.954359 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.955329 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:12.955539 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:12.955602 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:12.958456 (+ 2854us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:46005: BlockingRecv error: recv got EOF from 127.13.30.130:46005 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 01:01:12.958789 28785 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:01:13.035533 28790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:13.035772 28790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:13.035799 28790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:13.037019 28790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:13.037063 28790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:13.037091 28790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:01:13.038738 28790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/krb5kdc/oryx_127.13.30.131.keytab
--principal=oryx/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:43791
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=43959
--tserver_master_addrs=127.13.30.190:41827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:13.038969 28790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:13.039176 28790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:13.044657 28809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:13.044687 28803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:13.044844 28790 server_base.cc:1034] running on GCE node
W20260811 01:01:13.044657 28806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:13.045112 28790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:13.045398 28790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:13.046577 28790 hybrid_clock.cc:648] HybridClock initialized: now 1786410073046564 us; error 31 us; skew 500 ppm
Aug 11 01:01:13 dist-test-slave-42z9 krb5kdc[27273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410073, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:13.049276 28790 init.cc:377] Logged in from keytab as oryx/127.13.30.131@KRBTEST.COM (short username oryx)
I20260811 01:01:13.049839 28790 webserver.cc:460] Webserver started at http://127.13.30.131:43959/ using document root <none> and password file <none>
I20260811 01:01:13.050048 28790 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:13.050104 28790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:13.051512 28790 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:01:13.052078 28820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:13.052232 28790 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 01:01:13.052317 28790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "7f0ff0878261408f81b928ef698faa69"
format_stamp: "Formatted at 2026-08-11 01:01:12 on dist-test-slave-42z9"
server_key: "575806dbb8ec006eaece4936d4601c8b"
server_key_iv: "54c8b097e1b9b1e52521a9548c68d119"
server_key_version: "encryptionkey@0"
I20260811 01:01:13.052698 28790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:13.065245 28790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:13.067809 28790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:13.067945 28790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:13.068190 28790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:13.068547 28790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:13.068586 28790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:13.068611 28790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:13.068634 28790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:13.075062 28790 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:43791
I20260811 01:01:13.075117 29011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:43791 every 8 connection(s)
I20260811 01:01:13.075515 28790 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
Aug 11 01:01:13 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:13 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 01:01:13.083519 28553 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:13.076416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:39343 (local address 127.13.30.190:41827)
0811 01:01:13.076508 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:13.076510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:13.076695 (+ 185us) server_negotiation.cc:407] Connection header received
0811 01:01:13.077217 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:13.077218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:13.077229 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:13.077282 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:13.078375 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.078878 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.079988 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.080189 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.080259 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:13.083457 (+ 3198us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:39343: BlockingRecv error: recv got EOF from 127.13.30.131:39343 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 01:01:13.083581 29015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:13.076331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:39343)
0811 01:01:13.076538 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:13.076590 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:13.077129 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:13.077344 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:13.077347 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:13.078024 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:13.078269 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:13.078275 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.078954 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.078955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:13.079846 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:13.079849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.080270 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.080270 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:13.080379 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:13.080965 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:13.080976 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:13.083333 (+ 2357us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":92,"threads_started":1}
W20260811 01:01:13.083847 29012 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:41827 (0 consecutive failures): Not authorized: Failed to ping master at 127.13.30.190:41827: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
I20260811 01:01:13.084296 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 28790
Aug 11 01:01:13 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:13 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:13.089568 29015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:13.084099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:40727)
0811 01:01:13.084155 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:13.084167 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:13.084224 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:13.084487 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:13.084488 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:13.084661 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:13.084733 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:13.084736 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.085530 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.085531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:13.086090 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:13.086092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.086464 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.086465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:13.086544 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:13.087206 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:13.087214 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:13.089428 (+ 2214us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 01:01:13.089704 28553 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:13.084304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:40727 (local address 127.13.30.190:41827)
0811 01:01:13.084358 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:13.084361 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:13.084368 (+ 7us) server_negotiation.cc:407] Connection header received
0811 01:01:13.084399 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:13.084400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:13.084411 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:13.084457 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:13.084850 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.085433 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.086172 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.086378 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.086434 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:13.089624 (+ 3190us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:40727: BlockingRecv error: recv got EOF from 127.13.30.131:40727 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 01:01:13.092974 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:13.084686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58068 (local address 127.13.30.190:41827)
0811 01:01:13.084799 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:13.084800 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:13.084922 (+ 122us) server_negotiation.cc:407] Connection header received
0811 01:01:13.084961 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:13.084962 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:13.084973 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:13.085049 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:13.085636 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.086109 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.086980 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.087197 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.087258 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:13.088489 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:13.088496 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:13.088496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:13.088510 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:13.090636 (+ 2126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:13.091221 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:13.091227 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:13.091228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:13.091389 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:13.091726 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:13.091728 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:13.091728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:13.092334 (+ 606us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:13.092533 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:13.092729 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 01:01:13.092857 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":62,"threads_started":1}
Aug 11 01:01:13 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:13 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:13.095665 29015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:13.090077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:48883)
0811 01:01:13.090167 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:13.090183 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:13.090242 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:13.090385 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:13.090385 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:13.090566 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:13.090625 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:13.090627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.091551 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.091553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:13.092497 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:13.092503 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.093008 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.093010 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:13.093069 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:13.093565 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:13.093571 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:13.095596 (+ 2025us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 01:01:13.095921 28553 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:13.090163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:48883 (local address 127.13.30.190:41827)
0811 01:01:13.090239 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:13.090241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:13.090253 (+ 12us) server_negotiation.cc:407] Connection header received
0811 01:01:13.090301 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:13.090302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:13.090312 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:13.090358 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:13.090738 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.091432 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.092619 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.092912 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.092983 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:13.095839 (+ 2856us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:48883: BlockingRecv error: recv got EOF from 127.13.30.131:48883 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 01:01:13.095916 29012 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 01:01:13 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:13 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:13.821548 29019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:13.816840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:38681)
0811 01:01:13.816995 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:13.817007 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:13.817063 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:13.817187 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:13.817187 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:13.817358 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:13.817461 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:13.817463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.818100 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.818100 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:13.818686 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:13.818688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.819064 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.819064 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:13.819109 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:13.819620 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:13.819625 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:13.821473 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":67,"threads_started":1}
W20260811 01:01:13.821669 29020 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:13.816954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:38681 (local address 127.13.30.190:41827)
0811 01:01:13.817071 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:13.817073 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:13.817082 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:13.817106 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:13.817107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:13.817118 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:13.817173 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:13.817521 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.818045 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.818776 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.818988 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.819048 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:13.821595 (+ 2547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:38681: BlockingRecv error: recv got EOF from 127.13.30.129:38681 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":58,"threads_started":1}
Aug 11 01:01:13 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:13 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:13.963872 29023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:13.959253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:49525)
0811 01:01:13.959416 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:13.959428 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:13.959497 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:13.959622 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:13.959623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:13.959790 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:13.959849 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:13.959850 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.960547 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.960549 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:13.961121 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:13.961123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.961551 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.961552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:13.961607 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:13.962069 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:13.962074 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:13.963799 (+ 1725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":95,"threads_started":1}
W20260811 01:01:13.964010 29020 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:13.959316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:49525 (local address 127.13.30.190:41827)
0811 01:01:13.959392 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:13.959394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:13.959520 (+ 126us) server_negotiation.cc:407] Connection header received
0811 01:01:13.959545 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:13.959546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:13.959558 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:13.959607 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:13.959902 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.960418 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.961254 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:13.961481 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:13.961544 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:13.963936 (+ 2392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:49525: BlockingRecv error: recv got EOF from 127.13.30.130:49525 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 01:01:14 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:14 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:14.101361 29025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:14.096461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:51745)
0811 01:01:14.096651 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:14.096667 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:14.096746 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:14.096927 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:14.096928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:14.097109 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:14.097169 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:14.097171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:14.097914 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:14.097915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:14.098578 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:14.098581 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:14.098921 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:14.098922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:14.098959 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:14.099422 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:14.099427 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:14.101284 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":82,"threads_started":1}
W20260811 01:01:14.101562 29020 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:14.096628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:51745 (local address 127.13.30.190:41827)
0811 01:01:14.096697 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:14.096699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:14.096727 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:01:14.096841 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:14.096842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:14.096855 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:14.096907 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:14.097251 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:14.097806 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:14.098657 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:14.098858 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:14.098918 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:14.101487 (+ 2569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:51745: BlockingRecv error: recv got EOF from 127.13.30.131:51745 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 01:01:14 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:14 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:14.826781 29026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:14.822078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:60615)
0811 01:01:14.822249 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:14.822261 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:14.822322 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:14.822485 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:14.822486 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:14.822663 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:14.822717 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:14.822719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:14.823374 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:14.823375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:14.823919 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:14.823921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:14.824296 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:14.824296 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:14.824333 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:14.824823 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:14.824827 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:14.826713 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":82,"threads_started":1}
W20260811 01:01:14.826965 29027 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:14.822162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:60615 (local address 127.13.30.190:41827)
0811 01:01:14.822304 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:14.822306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:14.822315 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:14.822385 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:14.822386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:14.822396 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:14.822452 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:14.822785 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:14.823306 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:14.824016 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:14.824226 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:14.824293 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:14.826882 (+ 2589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:60615: BlockingRecv error: recv got EOF from 127.13.30.129:60615 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
Aug 11 01:01:14 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:14 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:14.969111 29030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:14.964376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:53917)
0811 01:01:14.964516 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:14.964529 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:14.964607 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:14.964731 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:14.964732 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:14.964917 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:14.964978 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:14.964980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:14.965697 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:14.965698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:14.966230 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:14.966232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:14.966587 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:14.966588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:14.966644 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:14.967123 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:14.967128 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:14.969045 (+ 1917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
W20260811 01:01:14.969287 29027 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:14.964467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:53917 (local address 127.13.30.190:41827)
0811 01:01:14.964537 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:14.964539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:14.964586 (+ 47us) server_negotiation.cc:407] Connection header received
0811 01:01:14.964669 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:14.964670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:14.964682 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:14.964726 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:14.965056 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:14.965610 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:14.966307 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:14.966521 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:14.966581 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:14.969214 (+ 2633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:53917: BlockingRecv error: recv got EOF from 127.13.30.130:53917 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 01:01:15 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:15 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:15.106317 29032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:15.101935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:34621)
0811 01:01:15.102126 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:15.102141 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:15.102216 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:15.102351 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:15.102351 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:15.102529 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:15.102583 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:15.102584 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:15.103186 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:15.103186 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:15.103715 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:15.103716 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:15.104001 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:15.104001 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:15.104039 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:15.104481 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:15.104485 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:15.106250 (+ 1765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":86,"threads_started":1}
W20260811 01:01:15.106513 29027 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:15.102133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:34621 (local address 127.13.30.190:41827)
0811 01:01:15.102195 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:15.102197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:15.102207 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:01:15.102270 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:15.102271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:15.102283 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:15.102336 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:15.102633 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:15.103130 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:15.103771 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:15.103951 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:15.103998 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:15.106446 (+ 2448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:34621: BlockingRecv error: recv got EOF from 127.13.30.131:34621 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 01:01:15 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:15 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:15.833556 29033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:15.827472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:40705)
0811 01:01:15.827647 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:15.827660 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:15.827740 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:15.828233 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:15.828236 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:15.828475 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:15.828551 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:15.828553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:15.829482 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:15.829483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:15.830195 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:15.830200 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:15.830639 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:15.830641 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:15.830708 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:15.831245 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:15.831251 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:15.833478 (+ 2227us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":77,"threads_started":1}
W20260811 01:01:15.833796 29035 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:15.827698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:40705 (local address 127.13.30.190:41827)
0811 01:01:15.827932 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:15.827934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:15.827950 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:01:15.827992 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:15.827993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:15.828007 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:15.828136 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:15.828722 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:15.829297 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:15.830330 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:15.830563 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:15.830634 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:15.833714 (+ 3080us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:40705: BlockingRecv error: recv got EOF from 127.13.30.129:40705 (error 108)
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":109,"threads_started":1}
Aug 11 01:01:15 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:15 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:15.974392 29036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:15.969690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:52845)
0811 01:01:15.969842 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:15.969854 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:15.969927 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:15.970111 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:15.970112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:15.970282 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:15.970335 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:15.970336 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:15.971096 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:15.971098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:15.971652 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:15.971654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:15.972059 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:15.972060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:15.972125 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:15.972618 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:15.972623 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:15.974309 (+ 1686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":81,"threads_started":1}
W20260811 01:01:15.974483 29035 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:15.969804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:52845 (local address 127.13.30.190:41827)
0811 01:01:15.969873 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:15.969875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:15.969908 (+ 33us) server_negotiation.cc:407] Connection header received
0811 01:01:15.970010 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:15.970011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:15.970026 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:15.970083 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:15.970388 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:15.970992 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:15.971730 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:15.971979 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:15.972043 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:15.974428 (+ 2385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:52845: BlockingRecv error: recv got EOF from 127.13.30.130:52845 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 01:01:16 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:16 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:16.111280 29037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:16.106831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:58335)
0811 01:01:16.106960 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:16.106973 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:16.107037 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:16.107151 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:16.107152 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:16.107332 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:16.107387 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:16.107389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:16.108023 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:16.108024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:16.108570 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:16.108572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:16.108937 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:16.108938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:16.108974 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:16.109472 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:16.109477 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:16.111214 (+ 1737us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
W20260811 01:01:16.111403 29035 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:16.106916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:58335 (local address 127.13.30.190:41827)
0811 01:01:16.106976 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:16.106978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:16.107021 (+ 43us) server_negotiation.cc:407] Connection header received
0811 01:01:16.107086 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:16.107087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:16.107101 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:16.107138 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:16.107448 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:16.107937 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:16.108676 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:16.108868 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:16.108934 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:16.111326 (+ 2392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:58335: BlockingRecv error: recv got EOF from 127.13.30.131:58335 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 11 01:01:16 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:16 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:16.841678 29038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:16.834033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:43953)
0811 01:01:16.834180 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:16.834191 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:16.834251 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:16.834369 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:16.834369 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:16.834541 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:16.834608 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:16.834610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:16.835253 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:16.835254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:16.835821 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:16.835823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:16.836154 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:16.836154 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:16.836193 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:16.839581 (+ 3388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:16.839589 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:16.841608 (+ 2019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":75,"threads_started":1}
W20260811 01:01:16.841821 29039 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:16.834109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:43953 (local address 127.13.30.190:41827)
0811 01:01:16.834228 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:16.834230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:16.834239 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:16.834296 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:16.834297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:16.834307 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:16.834363 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:16.834663 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:16.835184 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:16.835894 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:16.836100 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:16.836149 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:16.841740 (+ 5591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:43953: BlockingRecv error: recv got EOF from 127.13.30.129:43953 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":62,"threads_started":1}
Aug 11 01:01:16 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:16 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:16.979907 29041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:16.975009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:55885)
0811 01:01:16.975170 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:16.975183 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:16.975251 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:16.975387 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:16.975388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:16.975577 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:16.975628 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:16.975630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:16.976289 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:16.976290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:16.976816 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:16.976818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:16.977154 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:16.977154 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:16.977210 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:16.977809 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:16.977814 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:16.979841 (+ 2027us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
W20260811 01:01:16.980069 29039 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:16.975178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:55885 (local address 127.13.30.190:41827)
0811 01:01:16.975232 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:16.975234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:16.975246 (+ 12us) server_negotiation.cc:407] Connection header received
0811 01:01:16.975318 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:16.975319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:16.975332 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:16.975380 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:16.975701 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:16.976209 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:16.976893 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:16.977090 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:16.977149 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:16.980003 (+ 2854us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:55885: BlockingRecv error: recv got EOF from 127.13.30.130:55885 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 11 01:01:17 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:17 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:17.116386 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:17.111760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:39211)
0811 01:01:17.111886 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:17.111898 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:17.111971 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:17.112088 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:17.112088 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:17.112256 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:17.112310 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:17.112312 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:17.112958 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:17.112959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:17.113582 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:17.113584 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:17.113926 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:17.113927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:17.113989 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:17.114421 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:17.114425 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:17.116299 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":61,"threads_started":1}
W20260811 01:01:17.116478 29039 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:17.111844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:39211 (local address 127.13.30.190:41827)
0811 01:01:17.111896 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:17.111898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:17.111963 (+ 65us) server_negotiation.cc:407] Connection header received
0811 01:01:17.112012 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:17.112013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:17.112027 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:17.112079 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:17.112366 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:17.112889 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:17.113654 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:17.113852 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:17.113913 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:17.116419 (+ 2506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:39211: BlockingRecv error: recv got EOF from 127.13.30.131:39211 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 01:01:17 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:17 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:17.847056 29045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:17.842322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:60409)
0811 01:01:17.842458 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:17.842472 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:17.842546 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:17.842688 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:17.842689 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:17.842873 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:17.842927 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:17.842929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:17.843645 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:17.843647 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:17.844224 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:17.844226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:17.844543 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:17.844544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:17.844583 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:17.845027 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:17.845032 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:17.846971 (+ 1939us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":68,"threads_started":1}
W20260811 01:01:17.847157 29046 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:17.842382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:60409 (local address 127.13.30.190:41827)
0811 01:01:17.842531 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:17.842533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:17.842543 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:01:17.842612 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:17.842613 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:17.842625 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:17.842674 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:17.842995 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:17.843536 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:17.844289 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:17.844490 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:17.844535 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:17.847092 (+ 2557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:60409: BlockingRecv error: recv got EOF from 127.13.30.129:60409 (error 108)
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
Aug 11 01:01:17 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:17 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:17.985401 29047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:17.980498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:51507)
0811 01:01:17.980669 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:17.980683 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:17.980743 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:17.980915 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:17.980916 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:17.981098 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:17.981147 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:17.981149 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:17.981842 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:17.981843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:17.982362 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:17.982364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:17.982740 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:17.982741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:17.982798 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:17.983335 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:17.983340 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:17.985284 (+ 1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":72,"threads_started":1}
W20260811 01:01:17.985526 29046 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:17.980735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:51507 (local address 127.13.30.190:41827)
0811 01:01:17.980808 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:17.980810 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:17.980816 (+ 6us) server_negotiation.cc:407] Connection header received
0811 01:01:17.980839 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:17.980840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:17.980851 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:17.980899 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:17.981224 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:17.981766 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:17.982475 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:17.982671 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:17.982730 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:17.985434 (+ 2704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:51507: BlockingRecv error: recv got EOF from 127.13.30.130:51507 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 01:01:18 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:18 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:18.121819 29051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:18.117057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:34979)
0811 01:01:18.117250 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:18.117265 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:18.117369 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:18.117538 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:18.117539 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:18.117716 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:18.117768 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:18.117770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:18.118448 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:18.118449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:18.118973 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:18.118974 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:18.119355 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:18.119357 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:18.119407 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:18.119874 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:18.119880 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:18.121724 (+ 1844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":82,"threads_started":1}
W20260811 01:01:18.121894 29046 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:18.117207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:34979 (local address 127.13.30.190:41827)
0811 01:01:18.117278 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:18.117280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:18.117332 (+ 52us) server_negotiation.cc:407] Connection header received
0811 01:01:18.117425 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:18.117426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:18.117461 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:18.117520 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:18.117862 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:18.118375 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:18.119061 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:18.119251 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:18.119326 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:18.121825 (+ 2499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:34979: BlockingRecv error: recv got EOF from 127.13.30.131:34979 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 01:01:18 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:18 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:18.852372 29052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:18.847615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:59867)
0811 01:01:18.847761 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:18.847771 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:18.847831 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:18.847963 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:18.847964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:18.848133 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:18.848187 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:18.848189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:18.848870 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:18.848871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:18.849419 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:18.849420 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:18.849848 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:18.849849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:18.849911 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:18.850369 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:18.850374 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:18.852276 (+ 1902us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":87,"threads_started":1}
W20260811 01:01:18.852454 29054 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:18.847707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:59867 (local address 127.13.30.190:41827)
0811 01:01:18.847828 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:18.847830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:18.847839 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:18.847873 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:18.847874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:18.847886 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:18.847946 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:18.848251 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:18.848776 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:18.849548 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:18.849751 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:18.849814 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:18.852385 (+ 2571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:59867: BlockingRecv error: recv got EOF from 127.13.30.129:59867 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":56,"threads_started":1}
Aug 11 01:01:18 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:18 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:18.990732 29055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:18.986227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:53855)
0811 01:01:18.986375 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:18.986386 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:18.986451 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:18.986594 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:18.986595 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:18.986821 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:18.986879 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:18.986882 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:18.987521 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:18.987522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:18.988057 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:18.988058 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:18.988379 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:18.988380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:18.988446 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:18.988887 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:18.988892 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:18.990669 (+ 1777us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":71,"threads_started":1}
W20260811 01:01:18.990840 29054 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:18.986295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:53855 (local address 127.13.30.190:41827)
0811 01:01:18.986357 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:18.986359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:18.986465 (+ 106us) server_negotiation.cc:407] Connection header received
0811 01:01:18.986510 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:18.986511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:18.986525 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:18.986580 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:18.986946 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:18.987456 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:18.988113 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:18.988288 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:18.988332 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:18.990779 (+ 2447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:53855: BlockingRecv error: recv got EOF from 127.13.30.130:53855 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 01:01:19 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:19 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:19.127025 29056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:19.122355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:46027)
0811 01:01:19.122530 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:19.122544 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:19.122609 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:19.122739 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:19.122739 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:19.122906 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:19.122968 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:19.122970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:19.123634 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:19.123635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:19.124176 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:19.124178 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:19.124602 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:19.124603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:19.124657 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:19.125108 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:19.125113 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:19.126960 (+ 1847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":78,"threads_started":1}
W20260811 01:01:19.127187 29054 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:19.122495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:46027 (local address 127.13.30.190:41827)
0811 01:01:19.122551 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:19.122553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:19.122599 (+ 46us) server_negotiation.cc:407] Connection header received
0811 01:01:19.122667 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:19.122668 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:19.122679 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:19.122718 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:19.123026 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:19.123546 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:19.124269 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:19.124507 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:19.124569 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:19.127121 (+ 2552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:46027: BlockingRecv error: recv got EOF from 127.13.30.131:46027 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 01:01:19 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:19 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:19.858340 29057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:19.853062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:56227)
0811 01:01:19.853297 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:19.853312 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:19.853402 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:19.853740 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:19.853741 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:19.853980 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:19.854140 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:19.854147 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:19.854931 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:19.854932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:19.855531 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:19.855533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:19.855859 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:19.855859 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:19.855899 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:19.856441 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:19.856445 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:19.858273 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":126,"threads_started":1}
W20260811 01:01:19.858474 29060 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:19.853208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:56227 (local address 127.13.30.190:41827)
0811 01:01:19.853368 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:19.853371 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:19.853384 (+ 13us) server_negotiation.cc:407] Connection header received
0811 01:01:19.853550 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:19.853552 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:19.853569 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:19.853654 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:19.854252 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:19.854795 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:19.855603 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:19.855801 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:19.855852 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:19.858394 (+ 2542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:56227: BlockingRecv error: recv got EOF from 127.13.30.129:56227 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
Aug 11 01:01:19 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:19 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:19.996146 29061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:19.991344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:45479)
0811 01:01:19.991525 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:19.991537 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:19.991617 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:19.991752 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:19.991752 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:19.991959 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:19.992017 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:19.992019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:19.992905 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:19.992907 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:19.993477 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:19.993480 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:19.993839 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:19.993840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:19.993881 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:19.994353 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:19.994358 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:19.996074 (+ 1716us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":82,"threads_started":1}
W20260811 01:01:19.996264 29060 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:19.991472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:45479 (local address 127.13.30.190:41827)
0811 01:01:19.991544 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:19.991546 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:19.991597 (+ 51us) server_negotiation.cc:407] Connection header received
0811 01:01:19.991683 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:19.991684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:19.991696 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:19.991736 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:19.992136 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:19.992818 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:19.993554 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:19.993764 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:19.993833 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:19.996191 (+ 2358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:45479: BlockingRecv error: recv got EOF from 127.13.30.130:45479 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 01:01:20 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:20 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:20.132025 29064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:20.127565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:48071)
0811 01:01:20.127703 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:20.127715 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:20.127784 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:20.127916 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:20.127917 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:20.128094 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:20.128143 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:20.128145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:20.128801 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:20.128802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:20.129317 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:20.129319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:20.129713 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:20.129714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:20.129772 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:20.130217 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:20.130221 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:20.131964 (+ 1743us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
W20260811 01:01:20.132122 29060 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:20.127685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:48071 (local address 127.13.30.190:41827)
0811 01:01:20.127750 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:20.127752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:20.127765 (+ 13us) server_negotiation.cc:407] Connection header received
0811 01:01:20.127839 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:20.127840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:20.127855 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:20.127900 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:20.128206 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:20.128719 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:20.129390 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:20.129648 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:20.129705 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:20.132059 (+ 2354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:48071: BlockingRecv error: recv got EOF from 127.13.30.131:48071 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 01:01:20 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:20 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:20.863328 29066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:20.858863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:35903)
0811 01:01:20.859001 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:20.859012 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:20.859061 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:20.859239 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:20.859240 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:20.859424 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:20.859487 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:20.859489 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:20.860143 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:20.860144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:20.860675 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:20.860677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:20.861029 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:20.861030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:20.861072 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:20.861577 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:20.861582 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:20.863253 (+ 1671us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":65,"threads_started":1}
W20260811 01:01:20.863422 29067 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:20.858996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:35903 (local address 127.13.30.190:41827)
0811 01:01:20.859115 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:20.859116 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:20.859124 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:01:20.859148 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:20.859149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:20.859159 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:20.859222 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:20.859544 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:20.860064 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:20.860756 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:20.860967 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:20.861020 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:20.863353 (+ 2333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:35903: BlockingRecv error: recv got EOF from 127.13.30.129:35903 (error 108)
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":60,"threads_started":1}
Aug 11 01:01:20 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:20 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:21.001674 29071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:20.996744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:36179)
0811 01:01:20.996895 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:20.996910 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:20.996983 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:20.997121 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:20.997121 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:20.997299 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:20.997365 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:20.997367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:20.998333 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:20.998334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:20.998892 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:20.998894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:20.999252 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:20.999253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:20.999303 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:20.999763 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:20.999768 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:21.001591 (+ 1823us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":70,"threads_started":1}
W20260811 01:01:21.001747 29067 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:20.996875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:36179 (local address 127.13.30.190:41827)
0811 01:01:20.996948 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:20.996949 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:20.996963 (+ 14us) server_negotiation.cc:407] Connection header received
0811 01:01:20.997039 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:20.997040 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:20.997053 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:20.997103 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:20.997467 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:20.998251 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:20.998990 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:20.999189 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:20.999249 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:21.001693 (+ 2444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:36179: BlockingRecv error: recv got EOF from 127.13.30.130:36179 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 01:01:21 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:21 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:21.137076 29072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:21.132539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:44537)
0811 01:01:21.132714 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:21.132726 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:21.132787 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:21.132898 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:21.132899 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:21.133072 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:21.133124 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:21.133126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:21.133865 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:21.133866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:21.134461 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:21.134463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:21.134808 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:21.134809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:21.134847 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:21.135328 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:21.135332 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:21.137001 (+ 1669us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":89,"threads_started":1}
W20260811 01:01:21.137183 29067 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:21.132649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:44537 (local address 127.13.30.190:41827)
0811 01:01:21.132701 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:21.132703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:21.132781 (+ 78us) server_negotiation.cc:407] Connection header received
0811 01:01:21.132834 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:21.132835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:21.132847 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:21.132893 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:21.133187 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:21.133756 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:21.134556 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:21.134748 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:21.134804 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:21.137108 (+ 2304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:44537: BlockingRecv error: recv got EOF from 127.13.30.131:44537 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 11 01:01:21 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:21 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:21.874161 29073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:21.863950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:42437)
0811 01:01:21.864085 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:21.864095 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:21.864146 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:21.864522 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:21.864523 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:21.864705 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:21.864768 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:21.864770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:21.865554 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:21.865555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:21.866098 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:21.866100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:21.866510 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:21.866510 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:21.866550 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:21.871352 (+ 4802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:21.871360 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:21.874087 (+ 2727us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":75,"threads_started":1}
W20260811 01:01:21.874431 29074 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:21.864085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:42437 (local address 127.13.30.190:41827)
0811 01:01:21.864216 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:21.864218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:21.864227 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:21.864252 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:21.864253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:21.864265 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:21.864493 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:21.864893 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:21.865480 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:21.866193 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:21.866429 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:21.866487 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:21.874331 (+ 7844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:42437: BlockingRecv error: recv got EOF from 127.13.30.129:42437 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":66,"threads_started":1}
Aug 11 01:01:22 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:22 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:22.007254 29076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:22.002358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:43411)
0811 01:01:22.002519 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:22.002531 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:22.002599 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:22.002743 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:22.002744 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:22.002924 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:22.002985 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:22.002986 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:22.003651 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:22.003652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:22.004179 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:22.004180 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:22.004551 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:22.004552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:22.004610 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:22.005089 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:22.005093 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:22.007156 (+ 2063us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":71,"threads_started":1}
W20260811 01:01:22.007344 29074 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:22.002504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:43411 (local address 127.13.30.190:41827)
0811 01:01:22.002578 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:22.002580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:22.002592 (+ 12us) server_negotiation.cc:407] Connection header received
0811 01:01:22.002669 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:22.002670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:22.002683 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:22.002728 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:22.003060 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:22.003574 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:22.004285 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:22.004485 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:22.004543 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:22.007277 (+ 2734us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:43411: BlockingRecv error: recv got EOF from 127.13.30.130:43411 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 01:01:22 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:22 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:22.143553 29078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:22.137869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:55739)
0811 01:01:22.138093 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:22.138112 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:22.138222 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:22.138431 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:22.138433 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:22.138664 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:22.138855 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:22.138862 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:22.139994 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:22.139995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:22.140561 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:22.140563 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:22.140947 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:22.140948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:22.140997 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:22.141546 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:22.141550 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:22.143468 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":93,"threads_started":1}
W20260811 01:01:22.143635 29074 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:22.138037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:55739 (local address 127.13.30.190:41827)
0811 01:01:22.138163 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:22.138166 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:22.138187 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:01:22.138315 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:22.138316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:22.138340 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:22.138406 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:22.138980 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:22.139844 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:22.140668 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:22.140873 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:22.140934 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:22.143577 (+ 2643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:55739: BlockingRecv error: recv got EOF from 127.13.30.131:55739 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 11 01:01:22 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:22 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:22.879820 29080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:22.874804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:38495)
0811 01:01:22.874974 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:22.874985 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:22.875047 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:22.875191 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:22.875192 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:22.875383 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:22.875439 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:22.875441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:22.876102 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:22.876103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:22.876653 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:22.876654 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:22.877078 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:22.877080 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:22.877137 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:22.877809 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:22.877815 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:22.879745 (+ 1930us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":105,"threads_started":1}
W20260811 01:01:22.879936 29084 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:22.874927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:38495 (local address 127.13.30.190:41827)
0811 01:01:22.875064 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:22.875066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:22.875076 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:01:22.875107 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:22.875108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:22.875120 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:22.875177 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:22.875501 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:22.876030 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:22.876758 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:22.876972 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:22.877064 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:22.879853 (+ 2789us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:38495: BlockingRecv error: recv got EOF from 127.13.30.129:38495 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
Aug 11 01:01:23 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:23 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:23.013866 29086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:23.007953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:35485)
0811 01:01:23.008201 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:23.008216 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:23.008333 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:23.008577 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:23.008579 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:23.008774 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:23.008842 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:23.008844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:23.009582 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:23.009583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:23.010134 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:23.010137 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:23.010658 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:23.010659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:23.010720 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:23.011260 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:23.011265 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:23.013777 (+ 2512us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":89,"threads_started":1}
W20260811 01:01:23.014027 29084 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:23.008155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:35485 (local address 127.13.30.190:41827)
0811 01:01:23.008232 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:23.008234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:23.008325 (+ 91us) server_negotiation.cc:407] Connection header received
0811 01:01:23.008404 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:23.008406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:23.008422 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:23.008494 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:23.008942 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:23.009509 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:23.010278 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:23.010554 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:23.010642 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:23.013950 (+ 3308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:35485: BlockingRecv error: recv got EOF from 127.13.30.130:35485 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 01:01:23 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:23 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:23.149569 29087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:23.144185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:44407)
0811 01:01:23.144375 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:23.144389 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:23.144458 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:23.144611 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:23.144612 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:23.144857 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:23.144914 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:23.144916 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:23.145665 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:23.145666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:23.146214 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:23.146216 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:23.146560 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:23.146561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:23.146617 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:23.147193 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:23.147202 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:23.149480 (+ 2278us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":78,"threads_started":1}
W20260811 01:01:23.149636 29084 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:23.144366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:44407 (local address 127.13.30.190:41827)
0811 01:01:23.144443 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:23.144445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:23.144455 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:01:23.144516 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:23.144517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:23.144534 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:23.144584 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:23.144998 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:23.145584 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:23.146298 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:23.146494 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:23.146552 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:23.149577 (+ 3025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:44407: BlockingRecv error: recv got EOF from 127.13.30.131:44407 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 01:01:23 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:23 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:23.884995 29088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:23.880354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:44755)
0811 01:01:23.880502 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:23.880512 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:23.880562 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:23.880775 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:23.880776 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:23.880955 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:23.881008 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:23.881009 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:23.881682 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:23.881684 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:23.882248 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:23.882250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:23.882577 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:23.882579 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:23.882627 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:23.883052 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:23.883056 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:23.884898 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
W20260811 01:01:23.885075 29090 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:23.880500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:44755 (local address 127.13.30.190:41827)
0811 01:01:23.880643 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:23.880645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:23.880654 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:23.880680 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:23.880681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:23.880692 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:23.880761 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:23.881066 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:23.881605 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:23.882319 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:23.882512 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:23.882560 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:23.885011 (+ 2451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:44755: BlockingRecv error: recv got EOF from 127.13.30.129:44755 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":64,"threads_started":1}
Aug 11 01:01:24 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:24 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:24.019757 29091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:24.014428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:43395)
0811 01:01:24.014569 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:24.014580 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:24.014651 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:24.014881 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:24.014883 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:24.015131 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:24.015210 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:24.015212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:24.015962 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:24.015963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:24.016640 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:24.016643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:24.017104 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:24.017106 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:24.017183 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:24.017733 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:24.017738 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:24.019656 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
W20260811 01:01:24.019852 29090 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:24.014557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:43395 (local address 127.13.30.190:41827)
0811 01:01:24.014616 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:24.014618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:24.014633 (+ 15us) server_negotiation.cc:407] Connection header received
0811 01:01:24.014714 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:24.014715 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:24.014727 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:24.014779 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:24.015328 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:24.015844 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:24.016746 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:24.016964 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:24.017046 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:24.019794 (+ 2748us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:43395: BlockingRecv error: recv got EOF from 127.13.30.130:43395 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 11 01:01:24 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:24 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:24.154997 29092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:24.150241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:41155)
0811 01:01:24.150395 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:24.150406 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:24.150502 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:24.150636 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:24.150637 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:24.150819 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:24.150869 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:24.150871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:24.151542 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:24.151543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:24.152099 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:24.152102 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:24.152547 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:24.152549 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:24.152614 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:24.153096 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:24.153102 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:24.154916 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":70,"threads_started":1}
W20260811 01:01:24.155088 29090 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:24.150302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:41155 (local address 127.13.30.190:41827)
0811 01:01:24.150378 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:24.150380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:24.150462 (+ 82us) server_negotiation.cc:407] Connection header received
0811 01:01:24.150563 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:24.150564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:24.150579 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:24.150617 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:24.150924 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:24.151444 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:24.152214 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:24.152463 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:24.152531 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:24.155026 (+ 2495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:41155: BlockingRecv error: recv got EOF from 127.13.30.131:41155 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 01:01:24 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:24 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:24.889909 29093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:24.885550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:46587)
0811 01:01:24.885674 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:24.885685 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:24.885735 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:24.885872 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:24.885873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:24.886050 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:24.886100 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:24.886102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:24.886729 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:24.886729 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:24.887249 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:24.887250 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:24.887632 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:24.887633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:24.887691 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:24.888154 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:24.888158 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:24.889845 (+ 1687us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":70,"threads_started":1}
W20260811 01:01:24.890013 29095 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:24.885631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:46587 (local address 127.13.30.190:41827)
0811 01:01:24.885757 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:24.885759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:24.885768 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:24.885790 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:24.885791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:24.885802 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:24.885862 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:24.886152 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:24.886670 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:24.887332 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:24.887539 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:24.887596 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:24.889944 (+ 2348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:46587: BlockingRecv error: recv got EOF from 127.13.30.129:46587 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":64,"threads_started":1}
Aug 11 01:01:25 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:25 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:25.025612 29097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:25.020473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:50741)
0811 01:01:25.020617 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:25.020632 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:25.020703 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:25.020865 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:25.020866 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:25.021062 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:25.021123 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:25.021124 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:25.021938 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:25.021940 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:25.022516 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:25.022518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:25.022840 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:25.022841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:25.022880 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:25.023335 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:25.023369 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:25.025536 (+ 2167us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":71,"threads_started":1}
W20260811 01:01:25.025723 29095 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:25.020593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:50741 (local address 127.13.30.190:41827)
0811 01:01:25.020694 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:25.020696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:25.020708 (+ 12us) server_negotiation.cc:407] Connection header received
0811 01:01:25.020761 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:25.020762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:25.020774 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:25.020830 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:25.021251 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:25.021851 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:25.022589 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:25.022781 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:25.022831 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:25.025650 (+ 2819us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:50741: BlockingRecv error: recv got EOF from 127.13.30.130:50741 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 11 01:01:25 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:25 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:25.161358 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:25.155633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:35491)
0811 01:01:25.155769 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:25.155783 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:25.155847 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:25.156070 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:25.156071 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:25.156310 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:25.156372 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:25.156375 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:25.157348 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:25.157350 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:25.158197 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:25.158200 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:25.158800 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:25.158801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:25.158872 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:25.159463 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:25.159468 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:25.161295 (+ 1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":79,"threads_started":1}
W20260811 01:01:25.161513 29095 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:25.155850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:35491 (local address 127.13.30.190:41827)
0811 01:01:25.155934 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:25.155936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:25.155944 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:01:25.155990 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:25.155992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:25.156008 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:25.156061 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:25.156466 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:25.157238 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:25.158374 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:25.158658 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:25.158784 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:25.161417 (+ 2633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:35491: BlockingRecv error: recv got EOF from 127.13.30.131:35491 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 01:01:25 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:25 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:25.895952 29100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:25.890400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:52501)
0811 01:01:25.890533 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:25.890544 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:25.890594 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:25.890728 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:25.890729 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:25.890904 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:25.890956 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:25.890957 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:25.891714 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:25.891716 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:25.892516 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:25.892520 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:25.893028 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:25.893029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:25.893114 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:25.893605 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:25.893610 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:25.895869 (+ 2259us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":64,"threads_started":1}
W20260811 01:01:25.896100 29106 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:25.890465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:52501 (local address 127.13.30.190:41827)
0811 01:01:25.890606 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:25.890608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:25.890632 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:01:25.890652 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:25.890653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:25.890664 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:25.890713 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:25.891019 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:25.891545 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:25.892677 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:25.892901 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:25.892972 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:25.896028 (+ 3056us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:52501: BlockingRecv error: recv got EOF from 127.13.30.129:52501 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":80,"threads_started":1}
Aug 11 01:01:26 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:26 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:26.030985 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:26.026140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:53015)
0811 01:01:26.026302 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:26.026315 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:26.026375 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:26.026502 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:26.026503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:26.026694 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:26.026754 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:26.026755 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:26.027387 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:26.027388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:26.027927 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:26.027928 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:26.028243 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:26.028244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:26.028292 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:26.028748 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:26.028753 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:26.030919 (+ 2166us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":75,"threads_started":1}
W20260811 01:01:26.031133 29106 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:26.026255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:53015 (local address 127.13.30.190:41827)
0811 01:01:26.026308 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:26.026310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:26.026360 (+ 50us) server_negotiation.cc:407] Connection header received
0811 01:01:26.026423 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:26.026424 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:26.026435 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:26.026487 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:26.026808 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:26.027324 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:26.027992 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:26.028179 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:26.028227 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:26.031066 (+ 2839us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:53015: BlockingRecv error: recv got EOF from 127.13.30.130:53015 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 11 01:01:26 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:26 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:26.166503 29109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:26.161923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:46821)
0811 01:01:26.162082 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:26.162096 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:26.162170 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:26.162315 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:26.162316 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:26.162509 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:26.162557 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:26.162558 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:26.163213 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:26.163215 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:26.163751 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:26.163752 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:26.164086 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:26.164087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:26.164145 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:26.164616 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:26.164621 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:26.166407 (+ 1786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":90,"threads_started":1}
W20260811 01:01:26.166584 29106 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:26.162061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:46821 (local address 127.13.30.190:41827)
0811 01:01:26.162145 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:26.162147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:26.162158 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:01:26.162236 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:26.162238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:26.162253 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:26.162303 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:26.162631 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:26.163138 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:26.163834 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:26.164023 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:26.164081 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:26.166527 (+ 2446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:46821: BlockingRecv error: recv got EOF from 127.13.30.131:46821 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 01:01:26 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:26 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:26.905575 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:26.896501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:36035)
0811 01:01:26.896655 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:26.896669 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:26.896738 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:26.897112 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:26.897113 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:26.897302 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:26.897366 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:26.897368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:26.898318 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:26.898320 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:26.898924 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:26.898926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:26.899447 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:26.899450 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:26.899527 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:26.903510 (+ 3983us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:26.903518 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:26.905507 (+ 1989us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":70,"threads_started":1}
W20260811 01:01:26.905714 29115 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:26.896673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:36035 (local address 127.13.30.190:41827)
0811 01:01:26.896896 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:26.896899 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:26.896914 (+ 15us) server_negotiation.cc:407] Connection header received
0811 01:01:26.896952 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:26.896953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:26.896969 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:26.897087 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:26.897569 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:26.898200 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:26.899051 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:26.899302 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:26.899378 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:26.905628 (+ 6250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:36035: BlockingRecv error: recv got EOF from 127.13.30.129:36035 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":73,"threads_started":1}
Aug 11 01:01:27 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:27 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:27.037273 29117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:27.031608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:43895)
0811 01:01:27.031819 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:27.031832 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:27.031906 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:27.032040 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:27.032041 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:27.032226 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:27.032279 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:27.032281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:27.033015 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:27.033016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:27.033618 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:27.033620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:27.033994 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:27.033995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:27.034048 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:27.034556 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:27.034561 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:27.037190 (+ 2629us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":104,"threads_started":1}
W20260811 01:01:27.037400 29115 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:27.031736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:43895 (local address 127.13.30.190:41827)
0811 01:01:27.031826 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:27.031828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:27.031889 (+ 61us) server_negotiation.cc:407] Connection header received
0811 01:01:27.031970 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:27.031972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:27.031983 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:27.032023 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:27.032378 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:27.032929 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:27.033697 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:27.033904 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:27.033965 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:27.037340 (+ 3375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:43895: BlockingRecv error: recv got EOF from 127.13.30.130:43895 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 01:01:27 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:27 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.131@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:27.171924 29118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:27.167024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.131:55819)
0811 01:01:27.167161 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:27.167174 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:27.167241 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:27.167413 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:27.167414 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:27.167601 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:27.167654 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:27.167656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:27.168400 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:27.168401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:27.168967 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:27.168969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:27.169281 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:27.169282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:27.169322 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:27.169792 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:27.169797 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:27.171812 (+ 2015us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":72,"threads_started":1}
W20260811 01:01:27.171989 29115 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:27.167078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:55819 (local address 127.13.30.190:41827)
0811 01:01:27.167134 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:27.167136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:27.167244 (+ 108us) server_negotiation.cc:407] Connection header received
0811 01:01:27.167310 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:27.167311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:27.167328 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:27.167379 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:27.167810 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:27.168324 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:27.169040 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:27.169223 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:27.169277 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:27.171938 (+ 2661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.131:55819: BlockingRecv error: recv got EOF from 127.13.30.131:55819 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 11 01:01:27 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:27 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.129@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:27.910745 29122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:27.906198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.129:41303)
0811 01:01:27.906373 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:27.906388 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:27.906457 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:27.906613 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:27.906614 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:27.906784 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:27.906842 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:27.906844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:27.907553 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:27.907554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:27.908101 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:27.908103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:27.908394 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:27.908394 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:27.908431 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:27.908919 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:27.908924 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:27.910668 (+ 1744us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":80,"threads_started":1}
W20260811 01:01:27.910871 29123 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:27.906351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:41303 (local address 127.13.30.190:41827)
0811 01:01:27.906491 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:27.906493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:27.906501 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:01:27.906527 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:27.906527 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:27.906539 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:27.906597 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:27.906931 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:27.907476 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:27.908159 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:27.908343 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:27.908388 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:27.910795 (+ 2407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.129:41303: BlockingRecv error: recv got EOF from 127.13.30.129:41303 (error 108)
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":76,"threads_started":1}
Aug 11 01:01:28 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:01:28 dist-test-slave-42z9 krb5kdc[27273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.30.130@KRBTEST.COM for oryx/127.13.30.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:01:28.042348 29124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:28.037896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:41827 (local address 127.13.30.130:33011)
0811 01:01:28.038082 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:28.038092 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:28.038149 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:28.038281 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:28.038281 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:28.038456 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:28.038511 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:28.038513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.039132 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.039133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:28.039705 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:28.039708 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.040033 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.040033 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:28.040074 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:28.040532 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:28.040537 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:28.042270 (+ 1733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.30.190:41827: Server oryx/127.13.30.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":105,"threads_started":1}
W20260811 01:01:28.042461 29123 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:28.037990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:33011 (local address 127.13.30.190:41827)
0811 01:01:28.038074 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:28.038076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:28.038134 (+ 58us) server_negotiation.cc:407] Connection header received
0811 01:01:28.038212 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:28.038213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:28.038224 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:28.038265 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:28.038564 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.039074 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.039775 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.039975 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.040027 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:28.042380 (+ 2353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.30.130:33011: BlockingRecv error: recv got EOF from 127.13.30.130:33011 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 01:01:28.089473 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 28289
I20260811 01:01:28.103068 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 28554
I20260811 01:01:28.125675 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 28790
I20260811 01:01:28.137339 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 28153
2026-08-11T01:01:28Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17789 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T01:01:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:01:28Z Disabled control of system clock
I20260811 01:01:28.177166 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:43551
--webserver_interface=127.13.30.190
--webserver_port=0
--builtin_ntp_servers=127.13.30.148:35653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:43551
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 01:01:28.263898 29133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:28.264135 29133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:28.264158 29133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:28.265488 29133 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:01:28.265551 29133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:28.265564 29133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:28.265576 29133 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:01:28.265587 29133 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:01:28.267097 29133 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:35653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:43551
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:43551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:28.267400 29133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:28.267740 29133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:28.272809 29142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:28.272933 29146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:28.272984 29140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:28.273301 29133 server_base.cc:1034] running on GCE node
I20260811 01:01:28.273630 29133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:28.273983 29133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:28.275146 29133 hybrid_clock.cc:648] HybridClock initialized: now 1786410088275122 us; error 35 us; skew 500 ppm
I20260811 01:01:28.276473 29133 webserver.cc:460] Webserver started at http://127.13.30.190:35455/ using document root <none> and password file <none>
I20260811 01:01:28.276721 29133 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:28.276773 29133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:28.276921 29133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:28.278117 29133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "101204c07ea14cfba4b3cfadf39514b9"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "bfcffc22a94eae6832d1107dca1bfce6"
server_key_iv: "bf2f1cb693a08db58f62b9bc54e6b1cc"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.278478 29133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "101204c07ea14cfba4b3cfadf39514b9"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "bfcffc22a94eae6832d1107dca1bfce6"
server_key_iv: "bf2f1cb693a08db58f62b9bc54e6b1cc"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.279902 29133 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:01:28.280615 29159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:28.280786 29133 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:28.280880 29133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "101204c07ea14cfba4b3cfadf39514b9"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "bfcffc22a94eae6832d1107dca1bfce6"
server_key_iv: "bf2f1cb693a08db58f62b9bc54e6b1cc"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.280956 29133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:28.303400 29133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:28.303785 29133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:28.303936 29133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:28.308329 29133 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:43551
I20260811 01:01:28.308369 29243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:43551 every 8 connection(s)
I20260811 01:01:28.308745 29133 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:01:28.309540 29245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:28.312382 29245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9: Bootstrap starting.
I20260811 01:01:28.312692 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 29133
I20260811 01:01:28.312796 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:01:28.313019 13434 external_mini_cluster.cc:1428] Setting key 95e5d6088364844218fb3a57e031d6cc
I20260811 01:01:28.313285 29245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:28.313656 29245 log.cc:824] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:28.314515 29245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9: No bootstrap required, opened a new log
I20260811 01:01:28.315973 29245 raft_consensus.cc:348] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101204c07ea14cfba4b3cfadf39514b9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 43551 } }
I20260811 01:01:28.316129 29245 raft_consensus.cc:374] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:28.316164 29245 raft_consensus.cc:729] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 101204c07ea14cfba4b3cfadf39514b9, State: Initialized, Role: FOLLOWER
I20260811 01:01:28.316303 29245 consensus_queue.cc:260] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101204c07ea14cfba4b3cfadf39514b9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 43551 } }
I20260811 01:01:28.316668 29245 raft_consensus.cc:388] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:01:28.316722 29245 raft_consensus.cc:482] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:01:28.316766 29245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:28.317373 29245 raft_consensus.cc:504] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101204c07ea14cfba4b3cfadf39514b9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 43551 } }
I20260811 01:01:28.317512 29245 leader_election.cc:302] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 101204c07ea14cfba4b3cfadf39514b9; no voters:
I20260811 01:01:28.317688 29245 leader_election.cc:288] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:01:28.317857 29258 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:01:28.317998 29245 sys_catalog.cc:564] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:01:28.318105 29258 raft_consensus.cc:686] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [term 1 LEADER]: Becoming Leader. State: Replica: 101204c07ea14cfba4b3cfadf39514b9, State: Running, Role: LEADER
I20260811 01:01:28.318254 29258 consensus_queue.cc:237] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101204c07ea14cfba4b3cfadf39514b9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 43551 } }
I20260811 01:01:28.318612 29258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 101204c07ea14cfba4b3cfadf39514b9. Latest consensus state: current_term: 1 leader_uuid: "101204c07ea14cfba4b3cfadf39514b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101204c07ea14cfba4b3cfadf39514b9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 43551 } } }
I20260811 01:01:28.318710 29258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:28.318802 29252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:28.313683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53696 (local address 127.13.30.190:43551)
0811 01:01:28.313890 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:28.313899 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:28.313938 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:01:28.314496 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:28.314504 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:28.314573 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:28.314721 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:28.314952 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.315875 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.316715 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.317211 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.317327 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:28.318048 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:28.318052 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:28.318052 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:01:28.318258 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:28.318293 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:01:28.318305 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:28.318358 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:28.318459 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 01:01:28.318548 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":81,"threads_started":1}
I20260811 01:01:28.319039 29257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "101204c07ea14cfba4b3cfadf39514b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101204c07ea14cfba4b3cfadf39514b9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 43551 } } }
I20260811 01:01:28.319121 29257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:28.319084 29272 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:01:28.319782 29272 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:01:28.321367 29272 catalog_manager.cc:1347] Generated new cluster ID: acf75702a25744198f7f8d1760f1807d
I20260811 01:01:28.321415 29272 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:01:28.325583 29272 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:01:28.326103 29272 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:01:28.328558 29272 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 101204c07ea14cfba4b3cfadf39514b9: Generated new TSK 0
I20260811 01:01:28.328743 29272 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:01:28.332549 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:43551
--builtin_ntp_servers=127.13.30.148:35653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 01:01:28.430668 29286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:28.430897 29286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:28.430920 29286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:28.432163 29286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:28.432211 29286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:28.432240 29286 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:01:28.433733 29286 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:35653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:43551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:28.433997 29286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:28.434319 29286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:28.440389 29297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:28.440385 29296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:28.440616 29286 server_base.cc:1034] running on GCE node
W20260811 01:01:28.440389 29300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:28.440975 29286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:28.441277 29286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:28.442459 29286 hybrid_clock.cc:648] HybridClock initialized: now 1786410088442436 us; error 38 us; skew 500 ppm
I20260811 01:01:28.444056 29286 webserver.cc:460] Webserver started at http://127.13.30.129:34593/ using document root <none> and password file <none>
I20260811 01:01:28.444357 29286 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:28.444446 29286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:28.444604 29286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:28.446110 29286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "76c66e6da6a44691b8534cdb75553c14"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "a941387753982e4f937bbf333dff90b6"
server_key_iv: "2cdebb7f98a3a2efb83dcf4517bac4cd"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.446550 29286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "76c66e6da6a44691b8534cdb75553c14"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "a941387753982e4f937bbf333dff90b6"
server_key_iv: "2cdebb7f98a3a2efb83dcf4517bac4cd"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.448453 29286 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 01:01:28.449368 29308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:28.449574 29286 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:28.449673 29286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "76c66e6da6a44691b8534cdb75553c14"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "a941387753982e4f937bbf333dff90b6"
server_key_iv: "2cdebb7f98a3a2efb83dcf4517bac4cd"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.449751 29286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:28.472543 29286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:28.472888 29286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:28.473022 29286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:28.473253 29286 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:28.473632 29286 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:28.473668 29286 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:28.473697 29286 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:28.473721 29286 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:28.479383 29286 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:34627
I20260811 01:01:28.479460 29481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:34627 every 8 connection(s)
I20260811 01:01:28.479802 29286 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:01:28.484843 29252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:28.480517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:48925 (local address 127.13.30.190:43551)
0811 01:01:28.480583 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:28.480585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:28.480818 (+ 233us) server_negotiation.cc:407] Connection header received
0811 01:01:28.481302 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:28.481303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:28.481318 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:28.481370 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:28.482024 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.482537 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.483544 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.483730 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.483784 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:28.484596 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:28.484597 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:28.484597 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:01:28.484603 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:28.484619 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:01:28.484623 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:28.484663 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:28.484742 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 01:01:28.484767 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 01:01:28.485082 29488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:28.480504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:43551 (local address 127.13.30.129:48925)
0811 01:01:28.480702 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:28.480737 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:28.481227 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:28.481424 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:28.481427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:28.481449 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:28.481948 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:28.481953 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.482628 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.482629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:28.483458 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:28.483461 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.483801 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.483802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:28.483928 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:28.484444 (+ 516us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:01:28.484444 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:28.484476 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:01:28.484502 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:28.484674 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:28.484677 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:28.484679 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 01:01:28.484761 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 01:01:28.484862 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
I20260811 01:01:28.485638 29485 heartbeater.cc:347] Connected to a master server at 127.13.30.190:43551
I20260811 01:01:28.485737 29485 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:28.485932 29485 heartbeater.cc:511] Master 127.13.30.190:43551 requested a full tablet report, sending...
I20260811 01:01:28.486454 29185 ts_manager.cc:194] Registered new tserver with Master: 76c66e6da6a44691b8534cdb75553c14 (127.13.30.129:34627)
I20260811 01:01:28.487076 29185 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.30.129:48925
I20260811 01:01:28.489657 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 29286
I20260811 01:01:28.489735 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:01:28.489889 13434 external_mini_cluster.cc:1428] Setting key 836b125d79b20465b951951917d5ba9c
I20260811 01:01:28.490828 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:43551
--builtin_ntp_servers=127.13.30.148:35653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 01:01:28.576077 29490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:28.576310 29490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:28.576342 29490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:28.577612 29490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:28.577658 29490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:28.577696 29490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:01:28.579159 29490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:35653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:43551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:28.579454 29490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:28.579777 29490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:28.584895 29503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:28.585024 29499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:28.585073 29505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:28.585376 29490 server_base.cc:1034] running on GCE node
I20260811 01:01:28.585649 29490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:28.585892 29490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:28.587080 29490 hybrid_clock.cc:648] HybridClock initialized: now 1786410088587065 us; error 34 us; skew 500 ppm
I20260811 01:01:28.588488 29490 webserver.cc:460] Webserver started at http://127.13.30.130:46123/ using document root <none> and password file <none>
I20260811 01:01:28.588740 29490 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:28.588794 29490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:28.588943 29490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:28.590147 29490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "9b9b916989d846a09008e44ce962d085"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "0b54f84c30d03677d674d0d02859cd8f"
server_key_iv: "1d6277159f4ca1a46807c5bf2f1adc29"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.590512 29490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "9b9b916989d846a09008e44ce962d085"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "0b54f84c30d03677d674d0d02859cd8f"
server_key_iv: "1d6277159f4ca1a46807c5bf2f1adc29"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.591845 29490 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 01:01:28.592612 29516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:28.592775 29490 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:28.592867 29490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "9b9b916989d846a09008e44ce962d085"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "0b54f84c30d03677d674d0d02859cd8f"
server_key_iv: "1d6277159f4ca1a46807c5bf2f1adc29"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.592929 29490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:28.606715 29490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:28.607059 29490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:28.607197 29490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:28.607424 29490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:28.607756 29490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:28.607791 29490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:28.607822 29490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:28.607846 29490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:28.613605 29490 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:37363
I20260811 01:01:28.613685 29718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:37363 every 8 connection(s)
I20260811 01:01:28.614012 29490 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:01:28.616624 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 29490
I20260811 01:01:28.616715 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:01:28.616910 13434 external_mini_cluster.cc:1428] Setting key 217ed2661afa1c5dfc5efafa0273e7a5
I20260811 01:01:28.617920 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:43551
--builtin_ntp_servers=127.13.30.148:35653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 01:01:28.619879 29252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:28.614747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:39183 (local address 127.13.30.190:43551)
0811 01:01:28.614828 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:28.614830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:28.615035 (+ 205us) server_negotiation.cc:407] Connection header received
0811 01:01:28.615550 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:28.615552 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:28.615563 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:28.615605 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:28.616276 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.616995 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.618373 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.618646 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.618723 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:28.619616 (+ 893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:28.619618 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:28.619618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:01:28.619625 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:28.619643 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:01:28.619648 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:28.619697 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:28.619784 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 01:01:28.619814 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 01:01:28.620157 29723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:28.614721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:43551 (local address 127.13.30.130:39183)
0811 01:01:28.614921 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:28.614956 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:28.615456 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:28.615669 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:28.615673 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:28.615681 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:28.616195 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:28.616200 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.617105 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.617107 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:28.618296 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:28.618300 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.618725 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.618726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:28.618842 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:28.619451 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:01:28.619452 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:28.619483 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:01:28.619509 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:28.619706 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:28.619711 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:28.619715 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:01:28.619784 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 01:01:28.619908 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
I20260811 01:01:28.620626 29720 heartbeater.cc:347] Connected to a master server at 127.13.30.190:43551
I20260811 01:01:28.620730 29720 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:28.620925 29720 heartbeater.cc:511] Master 127.13.30.190:43551 requested a full tablet report, sending...
I20260811 01:01:28.621316 29185 ts_manager.cc:194] Registered new tserver with Master: 9b9b916989d846a09008e44ce962d085 (127.13.30.130:37363)
I20260811 01:01:28.621714 29185 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.30.130:39183
W20260811 01:01:28.705175 29727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:28.705405 29727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:28.705467 29727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:28.706773 29727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:28.706827 29727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:28.706866 29727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:01:28.708376 29727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:35653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:43551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:28.708670 29727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:28.709028 29727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:28.714766 29742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:28.714766 29739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:28.714792 29738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:28.715018 29727 server_base.cc:1034] running on GCE node
I20260811 01:01:28.715308 29727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:28.715634 29727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:28.716866 29727 hybrid_clock.cc:648] HybridClock initialized: now 1786410088716839 us; error 41 us; skew 500 ppm
I20260811 01:01:28.718605 29727 webserver.cc:460] Webserver started at http://127.13.30.131:39531/ using document root <none> and password file <none>
I20260811 01:01:28.718866 29727 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:28.718914 29727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:28.719045 29727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:28.720285 29727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "fe9eaf75a5c1468192a6e53dea0b0833"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "de89e973150d3916d98d0f9f8ef2f8f8"
server_key_iv: "20f6f90ca57d5adcf0b377a8e912ca8b"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.720642 29727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "fe9eaf75a5c1468192a6e53dea0b0833"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "de89e973150d3916d98d0f9f8ef2f8f8"
server_key_iv: "20f6f90ca57d5adcf0b377a8e912ca8b"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.722126 29727 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:01:28.722878 29750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:28.723013 29727 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:28.723089 29727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "fe9eaf75a5c1468192a6e53dea0b0833"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "de89e973150d3916d98d0f9f8ef2f8f8"
server_key_iv: "20f6f90ca57d5adcf0b377a8e912ca8b"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.723155 29727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:28.741663 29727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:28.742000 29727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:28.742131 29727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:28.742367 29727 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:28.742719 29727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:28.742753 29727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:28.742777 29727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:28.742800 29727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:28.748411 29727 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:35263
I20260811 01:01:28.748495 29930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:35263 every 8 connection(s)
I20260811 01:01:28.748824 29727 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:01:28.754829 29252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:28.749620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:49979 (local address 127.13.30.190:43551)
0811 01:01:28.749683 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:28.749686 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:28.749936 (+ 250us) server_negotiation.cc:407] Connection header received
0811 01:01:28.750497 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:28.750498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:28.750512 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:28.750567 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:28.751265 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.751911 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.753155 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.753371 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.753432 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:28.754526 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:28.754528 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:28.754528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:01:28.754534 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:28.754553 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:01:28.754558 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:28.754602 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:28.754693 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 01:01:28.754727 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 01:01:28.755103 29933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:28.749630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:43551 (local address 127.13.30.131:49979)
0811 01:01:28.749812 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:28.749848 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:28.750389 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:28.750634 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:28.750638 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:28.750647 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:28.751172 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:28.751176 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.752010 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.752011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:28.753070 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:28.753073 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:28.753481 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:28.753482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:28.753630 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:28.754343 (+ 713us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:01:28.754343 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:28.754379 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:01:28.754408 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:28.754613 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:28.754619 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:28.754623 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:01:28.754690 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 01:01:28.754815 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
I20260811 01:01:28.755192 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 29727
I20260811 01:01:28.755280 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:01:28.755497 13434 external_mini_cluster.cc:1428] Setting key f4a3c3593f27133cf3a725b5a4d8d2d2
I20260811 01:01:28.755697 29931 heartbeater.cc:347] Connected to a master server at 127.13.30.190:43551
I20260811 01:01:28.755795 29931 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:28.756013 29931 heartbeater.cc:511] Master 127.13.30.190:43551 requested a full tablet report, sending...
I20260811 01:01:28.756460 29185 ts_manager.cc:194] Registered new tserver with Master: fe9eaf75a5c1468192a6e53dea0b0833 (127.13.30.131:35263)
I20260811 01:01:28.756845 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:01:28.757027 29185 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.30.131:49979
W20260811 01:01:28.759017 29252 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:28.758535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53706 (local address 127.13.30.190:43551)
0811 01:01:28.758605 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:28.758608 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:28.758700 (+ 92us) server_negotiation.cc:407] Connection header received
0811 01:01:28.758753 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:28.758754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:28.758763 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:28.758806 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:28.758943 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53706: BlockingRecv error: recv got EOF from 127.0.0.1:53706 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 01:01:28.759029 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 29286
I20260811 01:01:28.775974 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 29490
I20260811 01:01:28.797595 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 29727
I20260811 01:01:28.805397 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 29133
2026-08-11T01:01:28Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (670 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T01:01:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:01:28Z Disabled control of system clock
I20260811 01:01:28.847687 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:42673
--webserver_interface=127.13.30.190
--webserver_port=0
--builtin_ntp_servers=127.13.30.148:34259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:42673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 01:01:28.931833 29946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:28.932082 29946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:28.932106 29946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:28.933342 29946 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:01:28.933399 29946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:28.933411 29946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:28.933423 29946 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:01:28.933434 29946 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:01:28.934985 29946 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:42673
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:42673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:28.935295 29946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:28.935636 29946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:28.940644 29959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:28.940688 29946 server_base.cc:1034] running on GCE node
W20260811 01:01:28.940652 29963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:28.940652 29957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:28.941110 29946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:28.941419 29946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:28.942593 29946 hybrid_clock.cc:648] HybridClock initialized: now 1786410088942582 us; error 44 us; skew 500 ppm
I20260811 01:01:28.944118 29946 webserver.cc:460] Webserver started at http://127.13.30.190:44937/ using document root <none> and password file <none>
I20260811 01:01:28.944353 29946 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:28.944401 29946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:28.944543 29946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:28.945688 29946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "4dbaf6c6118e4bc5876a7024bfe5eca9"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "f9387e5df0889152d85e6230d6600e46"
server_key_iv: "f481df6eb6636d4fa2714eae306b8f99"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.946100 29946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "4dbaf6c6118e4bc5876a7024bfe5eca9"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "f9387e5df0889152d85e6230d6600e46"
server_key_iv: "f481df6eb6636d4fa2714eae306b8f99"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.947412 29946 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:01:28.948119 29972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:28.948297 29946 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:28.948382 29946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "4dbaf6c6118e4bc5876a7024bfe5eca9"
format_stamp: "Formatted at 2026-08-11 01:01:28 on dist-test-slave-42z9"
server_key: "f9387e5df0889152d85e6230d6600e46"
server_key_iv: "f481df6eb6636d4fa2714eae306b8f99"
server_key_version: "encryptionkey@0"
I20260811 01:01:28.948444 29946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:28.951817 29946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:28.952092 29946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:28.952209 29946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:28.956172 29946 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:42673
I20260811 01:01:28.956238 30071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:42673 every 8 connection(s)
I20260811 01:01:28.956573 29946 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:01:28.957307 30073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:28.960351 30073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9: Bootstrap starting.
I20260811 01:01:28.961032 30073 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:28.961328 30073 log.cc:824] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:28.962438 30073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9: No bootstrap required, opened a new log
I20260811 01:01:28.962823 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 29946
I20260811 01:01:28.962922 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:01:28.963091 13434 external_mini_cluster.cc:1428] Setting key d3125477daa2bb78f274481afc4a246c
I20260811 01:01:28.964569 30073 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dbaf6c6118e4bc5876a7024bfe5eca9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42673 } }
I20260811 01:01:28.964745 30073 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:28.964785 30073 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbaf6c6118e4bc5876a7024bfe5eca9, State: Initialized, Role: FOLLOWER
I20260811 01:01:28.964982 30073 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dbaf6c6118e4bc5876a7024bfe5eca9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42673 } }
I20260811 01:01:28.965063 30073 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:01:28.965086 30073 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:01:28.965123 30073 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:28.965904 30077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:28.963654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40912 (local address 127.13.30.190:42673)
0811 01:01:28.963871 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:28.963879 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:28.963905 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:01:28.964528 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:28.964535 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:28.964582 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:28.964699 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:28.965429 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:28.965432 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:28.965432 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:01:28.965466 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:28.965511 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:01:28.965525 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:28.965582 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:28.965655 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 01:01:28.965710 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":97,"threads_started":1}
I20260811 01:01:28.965943 30073 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dbaf6c6118e4bc5876a7024bfe5eca9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42673 } }
I20260811 01:01:28.966048 30073 leader_election.cc:302] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4dbaf6c6118e4bc5876a7024bfe5eca9; no voters:
I20260811 01:01:28.966248 30073 leader_election.cc:288] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:01:28.966531 30073 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:01:28.966533 30078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:01:28.966691 30078 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [term 1 LEADER]: Becoming Leader. State: Replica: 4dbaf6c6118e4bc5876a7024bfe5eca9, State: Running, Role: LEADER
I20260811 01:01:28.966825 30078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dbaf6c6118e4bc5876a7024bfe5eca9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42673 } }
I20260811 01:01:28.967262 30079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4dbaf6c6118e4bc5876a7024bfe5eca9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dbaf6c6118e4bc5876a7024bfe5eca9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42673 } } }
I20260811 01:01:28.967366 30079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:28.967272 30080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4dbaf6c6118e4bc5876a7024bfe5eca9. Latest consensus state: current_term: 1 leader_uuid: "4dbaf6c6118e4bc5876a7024bfe5eca9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dbaf6c6118e4bc5876a7024bfe5eca9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42673 } } }
I20260811 01:01:28.967473 30080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9 [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:28.967665 30091 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:01:28.968259 30091 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:01:28.969947 30091 catalog_manager.cc:1347] Generated new cluster ID: 5b11b348ff57438086ebc130b46a2bb2
I20260811 01:01:28.970010 30091 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:01:28.990528 30091 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:01:28.990825 30091 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:01:28.995121 30091 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4dbaf6c6118e4bc5876a7024bfe5eca9: Generated new TSK 0
I20260811 01:01:28.995464 30091 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:01:29.002629 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42673
--builtin_ntp_servers=127.13.30.148:34259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 01:01:29.108415 30104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:29.108662 30104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:29.108686 30104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:29.109982 30104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:29.110030 30104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:29.110057 30104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:01:29.111544 30104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:29.111814 30104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:29.112138 30104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:29.117534 30112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:29.117679 30104 server_base.cc:1034] running on GCE node
W20260811 01:01:29.117558 30111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:29.117920 30114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:29.118147 30104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:29.118402 30104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:29.119558 30104 hybrid_clock.cc:648] HybridClock initialized: now 1786410089119545 us; error 31 us; skew 500 ppm
I20260811 01:01:29.120906 30104 webserver.cc:460] Webserver started at http://127.13.30.129:34533/ using document root <none> and password file <none>
I20260811 01:01:29.121167 30104 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:29.121220 30104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:29.121351 30104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:29.122583 30104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "aefbb4abb914459fabb4695c3158cd94"
format_stamp: "Formatted at 2026-08-11 01:01:29 on dist-test-slave-42z9"
server_key: "bb4592804e32b1b35aa2f6cf45babf27"
server_key_iv: "3973105722f23e5c56640c1620db21e6"
server_key_version: "encryptionkey@0"
I20260811 01:01:29.123008 30104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "aefbb4abb914459fabb4695c3158cd94"
format_stamp: "Formatted at 2026-08-11 01:01:29 on dist-test-slave-42z9"
server_key: "bb4592804e32b1b35aa2f6cf45babf27"
server_key_iv: "3973105722f23e5c56640c1620db21e6"
server_key_version: "encryptionkey@0"
I20260811 01:01:29.124506 30104 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:01:29.125427 30131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:29.125759 30104 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:01:29.125887 30104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "aefbb4abb914459fabb4695c3158cd94"
format_stamp: "Formatted at 2026-08-11 01:01:29 on dist-test-slave-42z9"
server_key: "bb4592804e32b1b35aa2f6cf45babf27"
server_key_iv: "3973105722f23e5c56640c1620db21e6"
server_key_version: "encryptionkey@0"
I20260811 01:01:29.125988 30104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:29.129917 30104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:29.130232 30104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:29.130359 30104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:29.130554 30104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:29.130852 30104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:29.130882 30104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:29.130908 30104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:29.130924 30104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:29.136796 30104 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:34911
I20260811 01:01:29.136860 30315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:34911 every 8 connection(s)
I20260811 01:01:29.137249 30104 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:01:29.139853 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 30104
I20260811 01:01:29.139938 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:01:29.140103 13434 external_mini_cluster.cc:1428] Setting key 916fb8aa64189b997088dce56f90950d
I20260811 01:01:29.141179 30077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:29.138595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:34555 (local address 127.13.30.190:42673)
0811 01:01:29.138663 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:29.138665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:29.138987 (+ 322us) server_negotiation.cc:407] Connection header received
0811 01:01:29.139535 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:29.139537 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:29.139544 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:29.139591 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:29.140943 (+ 1352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:29.140944 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:29.140945 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:01:29.140949 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:29.140964 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:01:29.140969 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:29.141017 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:29.141110 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 01:01:29.141122 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 01:01:29.141284 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42673
--builtin_ntp_servers=127.13.30.148:34259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 01:01:29.141471 30318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:29.138594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42673 (local address 127.13.30.129:34555)
0811 01:01:29.138841 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:29.138881 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:29.139432 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:29.139674 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:29.139678 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:29.139687 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:29.140767 (+ 1080us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:01:29.140768 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:29.140807 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:01:29.140848 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:29.141030 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:29.141036 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:29.141039 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:01:29.141117 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 01:01:29.141191 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":105,"threads_started":1}
I20260811 01:01:29.143321 30316 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42673
I20260811 01:01:29.143445 30316 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:29.143620 30316 heartbeater.cc:511] Master 127.13.30.190:42673 requested a full tablet report, sending...
I20260811 01:01:29.144155 30003 ts_manager.cc:194] Registered new tserver with Master: aefbb4abb914459fabb4695c3158cd94 (127.13.30.129:34911)
W20260811 01:01:29.228772 30320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:29.229087 30320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:29.229122 30320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:29.230588 30320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:29.230643 30320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:29.230672 30320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:01:29.232136 30320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:29.232362 30320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:29.232640 30320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:29.238045 30335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:29.238104 30320 server_base.cc:1034] running on GCE node
W20260811 01:01:29.238031 30331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:29.238035 30332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:29.238498 30320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:29.238766 30320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:29.239909 30320 hybrid_clock.cc:648] HybridClock initialized: now 1786410089239894 us; error 30 us; skew 500 ppm
I20260811 01:01:29.241259 30320 webserver.cc:460] Webserver started at http://127.13.30.130:44317/ using document root <none> and password file <none>
I20260811 01:01:29.241541 30320 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:29.241598 30320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:29.241740 30320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:29.242987 30320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "b2a98d13ba2049379c7be7051d4be558"
format_stamp: "Formatted at 2026-08-11 01:01:29 on dist-test-slave-42z9"
server_key: "a9042b07bab77ab10d921240709d6d2e"
server_key_iv: "77f9b7ad9bb468c1a8f07de4b9f23542"
server_key_version: "encryptionkey@0"
I20260811 01:01:29.243394 30320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "b2a98d13ba2049379c7be7051d4be558"
format_stamp: "Formatted at 2026-08-11 01:01:29 on dist-test-slave-42z9"
server_key: "a9042b07bab77ab10d921240709d6d2e"
server_key_iv: "77f9b7ad9bb468c1a8f07de4b9f23542"
server_key_version: "encryptionkey@0"
I20260811 01:01:29.244925 30320 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:01:29.245697 30346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:29.245850 30320 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:29.245939 30320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "b2a98d13ba2049379c7be7051d4be558"
format_stamp: "Formatted at 2026-08-11 01:01:29 on dist-test-slave-42z9"
server_key: "a9042b07bab77ab10d921240709d6d2e"
server_key_iv: "77f9b7ad9bb468c1a8f07de4b9f23542"
server_key_version: "encryptionkey@0"
I20260811 01:01:29.246004 30320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:29.249368 30320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:29.249668 30320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:29.249795 30320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:29.249997 30320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:29.250309 30320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:29.250345 30320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:29.250373 30320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:29.250406 30320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:29.256088 30320 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:33271
I20260811 01:01:29.256139 30535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:33271 every 8 connection(s)
I20260811 01:01:29.256487 30320 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:01:29.257521 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 30320
I20260811 01:01:29.257642 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:01:29.257843 13434 external_mini_cluster.cc:1428] Setting key 832e012d909d509b27b8386a5ab74704
I20260811 01:01:29.258771 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42673
--builtin_ntp_servers=127.13.30.148:34259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 01:01:29.259991 30077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:29.257197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:36621 (local address 127.13.30.190:42673)
0811 01:01:29.257254 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:29.257257 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:29.257553 (+ 296us) server_negotiation.cc:407] Connection header received
0811 01:01:29.258424 (+ 871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:29.258425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:29.258430 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:29.258485 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:29.259736 (+ 1251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:29.259738 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:29.259738 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:01:29.259743 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:29.259764 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:01:29.259769 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:29.259819 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:29.259895 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 01:01:29.259911 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 01:01:29.260205 30541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:29.257179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42673 (local address 127.13.30.130:36621)
0811 01:01:29.257397 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:29.257468 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:29.258115 (+ 647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:29.258585 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:29.258590 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:29.258599 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:29.259578 (+ 979us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:01:29.259578 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:29.259609 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:01:29.259641 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:29.259825 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:29.259832 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:29.259835 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:01:29.259907 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 01:01:29.259977 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":84,"threads_started":1}
I20260811 01:01:29.260658 30537 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42673
I20260811 01:01:29.260759 30537 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:29.260921 30537 heartbeater.cc:511] Master 127.13.30.190:42673 requested a full tablet report, sending...
I20260811 01:01:29.261312 30003 ts_manager.cc:194] Registered new tserver with Master: b2a98d13ba2049379c7be7051d4be558 (127.13.30.130:33271)
W20260811 01:01:29.345000 30547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:29.345247 30547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:29.345273 30547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:29.346628 30547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:29.346678 30547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:29.346706 30547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:01:29.348156 30547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:29.348400 30547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:29.348770 30547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:29.354406 30553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:29.354490 30554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:29.354449 30556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:29.354764 30547 server_base.cc:1034] running on GCE node
I20260811 01:01:29.355106 30547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:29.355590 30547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:29.356837 30547 hybrid_clock.cc:648] HybridClock initialized: now 1786410089356794 us; error 51 us; skew 500 ppm
I20260811 01:01:29.358361 30547 webserver.cc:460] Webserver started at http://127.13.30.131:37867/ using document root <none> and password file <none>
I20260811 01:01:29.358644 30547 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:29.358700 30547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:29.358840 30547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:29.360030 30547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "fbe904adc68446d2a7177fa369139257"
format_stamp: "Formatted at 2026-08-11 01:01:29 on dist-test-slave-42z9"
server_key: "b93c72007ab6fd8e8f8c545beb19a7cf"
server_key_iv: "f5cd6fda707c0f45877ed690e1814c8c"
server_key_version: "encryptionkey@0"
I20260811 01:01:29.360391 30547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "fbe904adc68446d2a7177fa369139257"
format_stamp: "Formatted at 2026-08-11 01:01:29 on dist-test-slave-42z9"
server_key: "b93c72007ab6fd8e8f8c545beb19a7cf"
server_key_iv: "f5cd6fda707c0f45877ed690e1814c8c"
server_key_version: "encryptionkey@0"
I20260811 01:01:29.361963 30547 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:01:29.362771 30565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:29.362957 30547 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:29.363054 30547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "fbe904adc68446d2a7177fa369139257"
format_stamp: "Formatted at 2026-08-11 01:01:29 on dist-test-slave-42z9"
server_key: "b93c72007ab6fd8e8f8c545beb19a7cf"
server_key_iv: "f5cd6fda707c0f45877ed690e1814c8c"
server_key_version: "encryptionkey@0"
I20260811 01:01:29.363126 30547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:29.366806 30547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:29.367120 30547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:29.367251 30547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:29.367462 30547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:29.367805 30547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:29.367851 30547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:29.367884 30547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:29.367909 30547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:29.373859 30547 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:41365
I20260811 01:01:29.373934 30746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:41365 every 8 connection(s)
I20260811 01:01:29.374260 30547 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:01:29.375098 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 30547
I20260811 01:01:29.375206 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:01:29.375409 13434 external_mini_cluster.cc:1428] Setting key 9316582a509cd7a4a5a67e71c1338de5
I20260811 01:01:29.377667 30077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:29.375021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:35395 (local address 127.13.30.190:42673)
0811 01:01:29.375076 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:29.375078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:29.375397 (+ 319us) server_negotiation.cc:407] Connection header received
0811 01:01:29.376031 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:29.376032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:29.376041 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:29.376093 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:29.377327 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:29.377329 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:29.377329 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:01:29.377334 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:29.377351 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:01:29.377356 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:29.377407 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:29.377572 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 01:01:29.377592 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 01:01:29.377856 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:29.375027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42673 (local address 127.13.30.131:35395)
0811 01:01:29.375263 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:29.375310 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:29.375941 (+ 631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:29.376170 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:29.376175 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:29.376186 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:29.377164 (+ 978us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:01:29.377165 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:29.377198 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:01:29.377230 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:29.377422 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:29.377428 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:29.377431 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:01:29.377577 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 01:01:29.377646 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":113,"threads_started":1}
I20260811 01:01:29.378360 30747 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42673
I20260811 01:01:29.378468 30747 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:29.378633 30747 heartbeater.cc:511] Master 127.13.30.190:42673 requested a full tablet report, sending...
I20260811 01:01:29.379019 30003 ts_manager.cc:194] Registered new tserver with Master: fbe904adc68446d2a7177fa369139257 (127.13.30.131:41365)
I20260811 01:01:29.387336 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 01:01:29.389253 30077 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:01:29.388799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40916 (local address 127.13.30.190:42673)
0811 01:01:29.388862 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:29.388864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:29.388954 (+ 90us) server_negotiation.cc:407] Connection header received
0811 01:01:29.388999 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:29.389000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:29.389005 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:29.389059 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:29.389175 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40916: BlockingRecv error: recv got EOF from 127.0.0.1:40916 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 01:01:29.389322 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 30104
I20260811 01:01:29.397286 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 30320
I20260811 01:01:29.414868 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 30547
I20260811 01:01:29.436139 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 29946
2026-08-11T01:01:29Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (624 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:01:29 dist-test-slave-42z9 krb5kdc[30762](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:01:29 dist-test-slave-42z9 krb5kdc[30762](info): set up 2 sockets
Aug 11 01:01:29 dist-test-slave-42z9 krb5kdc[30762](info): commencing operation
krb5kdc: starting...
W20260811 01:01:30.624286 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:01:30 dist-test-slave-42z9 krb5kdc[30762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410090, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:01:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:01:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:01:30.750295 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:38305
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:46563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:38305
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:30.834970 30795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:30.835189 30795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:30.835220 30795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:30.836428 30795 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:01:30.836474 30795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:30.836493 30795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:30.836508 30795 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:01:30.836524 30795 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:01:30.838076 30795 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:46563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:38305
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:38305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:30.838333 30795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:30.838562 30795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:01:30.843766 30795 server_base.cc:1034] running on GCE node
W20260811 01:01:30.843837 30805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:30.843676 30802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:30.843673 30803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:30.844308 30795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:30.844683 30795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:30.845960 30795 hybrid_clock.cc:648] HybridClock initialized: now 1786410090845933 us; error 39 us; skew 500 ppm
Aug 11 01:01:30 dist-test-slave-42z9 krb5kdc[30762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410090, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:30.848508 30795 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:01:30.848973 30795 webserver.cc:460] Webserver started at http://127.13.30.190:36731/ using document root <none> and password file <none>
I20260811 01:01:30.849184 30795 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:30.849225 30795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:30.849316 30795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:30.850420 30795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "3042e95eaa814031b81112be2a4b1aee"
format_stamp: "Formatted at 2026-08-11 01:01:30 on dist-test-slave-42z9"
server_key: "90996838735f902f9c94c42ee5af67a3"
server_key_iv: "b1ffbd924250db605eeb8a3873a045dd"
server_key_version: "encryptionkey@0"
I20260811 01:01:30.850716 30795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "3042e95eaa814031b81112be2a4b1aee"
format_stamp: "Formatted at 2026-08-11 01:01:30 on dist-test-slave-42z9"
server_key: "90996838735f902f9c94c42ee5af67a3"
server_key_iv: "b1ffbd924250db605eeb8a3873a045dd"
server_key_version: "encryptionkey@0"
I20260811 01:01:30.852069 30795 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:01:30.852747 30817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:30.852917 30795 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:30.853006 30795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "3042e95eaa814031b81112be2a4b1aee"
format_stamp: "Formatted at 2026-08-11 01:01:30 on dist-test-slave-42z9"
server_key: "90996838735f902f9c94c42ee5af67a3"
server_key_iv: "b1ffbd924250db605eeb8a3873a045dd"
server_key_version: "encryptionkey@0"
I20260811 01:01:30.853067 30795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:30.870991 30795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:30.872794 30795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:30.872915 30795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:30.876946 30795 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:38305
I20260811 01:01:30.877002 30902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:38305 every 8 connection(s)
I20260811 01:01:30.877321 30795 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:01:30.878382 30903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:30.880833 30903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee: Bootstrap starting.
I20260811 01:01:30.881433 30903 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:30.881739 30903 log.cc:824] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:30.882479 30903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee: No bootstrap required, opened a new log
I20260811 01:01:30.884133 30903 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3042e95eaa814031b81112be2a4b1aee" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38305 } }
I20260811 01:01:30.884285 30903 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:30.884320 30903 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3042e95eaa814031b81112be2a4b1aee, State: Initialized, Role: FOLLOWER
I20260811 01:01:30.884459 30903 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3042e95eaa814031b81112be2a4b1aee" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38305 } }
I20260811 01:01:30.884523 30903 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:01:30.884555 30903 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:01:30.884604 30903 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:30.885504 30903 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3042e95eaa814031b81112be2a4b1aee" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38305 } }
I20260811 01:01:30.885609 30903 leader_election.cc:302] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3042e95eaa814031b81112be2a4b1aee; no voters:
I20260811 01:01:30.885778 30903 leader_election.cc:288] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:01:30.885823 30907 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:01:30.885977 30907 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [term 1 LEADER]: Becoming Leader. State: Replica: 3042e95eaa814031b81112be2a4b1aee, State: Running, Role: LEADER
I20260811 01:01:30.886078 30907 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3042e95eaa814031b81112be2a4b1aee" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38305 } }
I20260811 01:01:30.886083 30903 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:01:30.886484 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 30795
I20260811 01:01:30.886520 30911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3042e95eaa814031b81112be2a4b1aee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3042e95eaa814031b81112be2a4b1aee" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38305 } } }
I20260811 01:01:30.886595 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:01:30.886613 30911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:30.886508 30913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3042e95eaa814031b81112be2a4b1aee. Latest consensus state: current_term: 1 leader_uuid: "3042e95eaa814031b81112be2a4b1aee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3042e95eaa814031b81112be2a4b1aee" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38305 } } }
I20260811 01:01:30.886807 30913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee [sys.catalog]: This master's current role is: LEADER
I20260811 01:01:30.886806 13434 external_mini_cluster.cc:1428] Setting key bab342125975ba05b6beee04cf854d89
I20260811 01:01:30.886947 30919 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:01:30.887462 30919 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:01:30.889148 30919 catalog_manager.cc:1347] Generated new cluster ID: e8e0d9fbcc7f449b8b0520ba6855648f
I20260811 01:01:30.889215 30919 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 01:01:30 dist-test-slave-42z9 krb5kdc[30762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410090, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:01:30.898969 30927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:30.887345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40796 (local address 127.13.30.190:38305)
0811 01:01:30.887682 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:30.887693 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:30.887725 (+ 32us) server_negotiation.cc:407] Connection header received
0811 01:01:30.887838 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:30.887846 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:30.887907 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:30.888112 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:30.888855 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:30.890287 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:30.891382 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:30.892017 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:30.892126 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:30.895079 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:30.895085 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:30.895085 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:30.895103 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:30.897193 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:30.897635 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:30.897639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:30.897640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:30.897776 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:30.897959 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:30.897960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:30.897960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:30.898307 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:30.898463 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:30.898563 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 01:01:30.898723 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":73,"threads_started":1}
I20260811 01:01:30.911140 30919 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:01:30.911713 30919 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:01:30.926124 30919 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee: Generated new TSK 0
I20260811 01:01:30.926353 30919 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:01:30.953857 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:38305
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:46563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:31.040685 30946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:31.040904 30946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:31.040931 30946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:31.042255 30946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:31.042308 30946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:31.042339 30946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:01:31.043951 30946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:46563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:38305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:31.044216 30946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:31.044450 30946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:31.049649 30958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:31.049773 30946 server_base.cc:1034] running on GCE node
W20260811 01:01:31.049633 30957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:31.049633 30962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:31.050114 30946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:31.050371 30946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:31.051560 30946 hybrid_clock.cc:648] HybridClock initialized: now 1786410091051545 us; error 31 us; skew 500 ppm
Aug 11 01:01:31 dist-test-slave-42z9 krb5kdc[30762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410091, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:31.054252 30946 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:01:31.054723 30946 webserver.cc:460] Webserver started at http://127.13.30.129:41187/ using document root <none> and password file <none>
I20260811 01:01:31.054947 30946 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:31.055001 30946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:31.055140 30946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:31.056319 30946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "5ef793ec8b944fe19a171358f9f2cddf"
format_stamp: "Formatted at 2026-08-11 01:01:31 on dist-test-slave-42z9"
server_key: "1291cf804c2a1dbf2b6ab70d4ecf047f"
server_key_iv: "9f5ae145c89cba55219d06beb39e5132"
server_key_version: "encryptionkey@0"
I20260811 01:01:31.056697 30946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "5ef793ec8b944fe19a171358f9f2cddf"
format_stamp: "Formatted at 2026-08-11 01:01:31 on dist-test-slave-42z9"
server_key: "1291cf804c2a1dbf2b6ab70d4ecf047f"
server_key_iv: "9f5ae145c89cba55219d06beb39e5132"
server_key_version: "encryptionkey@0"
I20260811 01:01:31.058189 30946 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:01:31.058970 30981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:31.059139 30946 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:31.059229 30946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "5ef793ec8b944fe19a171358f9f2cddf"
format_stamp: "Formatted at 2026-08-11 01:01:31 on dist-test-slave-42z9"
server_key: "1291cf804c2a1dbf2b6ab70d4ecf047f"
server_key_iv: "9f5ae145c89cba55219d06beb39e5132"
server_key_version: "encryptionkey@0"
I20260811 01:01:31.059307 30946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:31.070550 30946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:31.073115 30946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:31.073323 30946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:31.073616 30946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:31.073961 30946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:31.073999 30946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:31.074031 30946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:31.074048 30946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:31.080637 30946 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:44345
I20260811 01:01:31.080709 31156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:44345 every 8 connection(s)
I20260811 01:01:31.081028 30946 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
Aug 11 01:01:31 dist-test-slave-42z9 krb5kdc[30762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410091, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:01:31.089991 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 30946
I20260811 01:01:31.090098 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:01:31.090291 13434 external_mini_cluster.cc:1428] Setting key 38bbe5aa6600379501409d2764e52e55
I20260811 01:01:31.090580 30927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.081827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:43407 (local address 127.13.30.190:38305)
0811 01:01:31.081894 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:31.081896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:31.082077 (+ 181us) server_negotiation.cc:407] Connection header received
0811 01:01:31.082649 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:31.082651 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:31.082663 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:31.082728 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:31.083671 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.084185 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.085185 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.085404 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.085510 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.087864 (+ 2354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:31.087865 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:31.087866 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:31.087874 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:31.089095 (+ 1221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:31.089522 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:31.089522 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:31.089523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:31.089574 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:31.089781 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:31.089782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:31.089782 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:31.089941 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:31.090016 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:31.090393 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 01:01:31.090505 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 01:01:31.090878 31162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.081779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:38305 (local address 127.13.30.129:43407)
0811 01:01:31.081951 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:31.081996 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:31.082526 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:31.082785 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:31.082789 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:31.083385 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:31.083595 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.083600 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.084255 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.084256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.085097 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.085101 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.085525 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.085526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.085643 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.086120 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:31.086130 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:31.087753 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:31.089170 (+ 1417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:31.089177 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:31.089180 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:31.089435 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:31.089623 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:31.089623 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:31.089623 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:31.089721 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:31.090038 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:31.090046 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:31.090221 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 01:01:31.090346 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 01:01:31.090547 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260811 01:01:31.091509 31158 heartbeater.cc:347] Connected to a master server at 127.13.30.190:38305
I20260811 01:01:31.091606 31158 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:31.091807 31158 heartbeater.cc:511] Master 127.13.30.190:38305 requested a full tablet report, sending...
I20260811 01:01:31.092403 30851 ts_manager.cc:194] Registered new tserver with Master: 5ef793ec8b944fe19a171358f9f2cddf (127.13.30.129:44345)
I20260811 01:01:31.093189 30851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:43407
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:01:31.118157 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:38305
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:46563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:31.205921 31167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:31.206147 31167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:31.206172 31167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:31.207371 31167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:31.207412 31167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:31.207438 31167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:01:31.208952 31167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:46563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:38305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:31.209187 31167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:31.209398 31167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:31.214608 31176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:31.214622 31180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:31.214635 31175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:31.214807 31167 server_base.cc:1034] running on GCE node
I20260811 01:01:31.215060 31167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:31.215315 31167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:31.216508 31167 hybrid_clock.cc:648] HybridClock initialized: now 1786410091216492 us; error 32 us; skew 500 ppm
Aug 11 01:01:31 dist-test-slave-42z9 krb5kdc[30762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410091, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:31.219113 31167 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:01:31.219636 31167 webserver.cc:460] Webserver started at http://127.13.30.130:41377/ using document root <none> and password file <none>
I20260811 01:01:31.219851 31167 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:31.219899 31167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:31.220031 31167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:31.221092 31167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "767cf81ac05c4779970d0357ebb84ac0"
format_stamp: "Formatted at 2026-08-11 01:01:31 on dist-test-slave-42z9"
server_key: "36004b4f3583f43215c82a6acb9f0259"
server_key_iv: "4f5a0234706a960b32ef5cdd091cd4ad"
server_key_version: "encryptionkey@0"
I20260811 01:01:31.221423 31167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "767cf81ac05c4779970d0357ebb84ac0"
format_stamp: "Formatted at 2026-08-11 01:01:31 on dist-test-slave-42z9"
server_key: "36004b4f3583f43215c82a6acb9f0259"
server_key_iv: "4f5a0234706a960b32ef5cdd091cd4ad"
server_key_version: "encryptionkey@0"
I20260811 01:01:31.222862 31167 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:01:31.223656 31192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:31.223815 31167 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 01:01:31.223906 31167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "767cf81ac05c4779970d0357ebb84ac0"
format_stamp: "Formatted at 2026-08-11 01:01:31 on dist-test-slave-42z9"
server_key: "36004b4f3583f43215c82a6acb9f0259"
server_key_iv: "4f5a0234706a960b32ef5cdd091cd4ad"
server_key_version: "encryptionkey@0"
I20260811 01:01:31.223978 31167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:31.234917 31167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:31.237162 31167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:31.237305 31167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:31.237561 31167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:31.237885 31167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:31.237920 31167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:31.237942 31167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:31.237965 31167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:31.243575 31167 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:33675
I20260811 01:01:31.243647 31357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:33675 every 8 connection(s)
I20260811 01:01:31.243961 31167 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:01:31.244913 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 31167
I20260811 01:01:31.245007 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:01:31.245193 13434 external_mini_cluster.cc:1428] Setting key 1c2a61651fa9de183fe20040e1b52873
Aug 11 01:01:31 dist-test-slave-42z9 krb5kdc[30762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410091, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:01:31.253587 30927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.244672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:54177 (local address 127.13.30.190:38305)
0811 01:01:31.244731 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:31.244733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:31.244955 (+ 222us) server_negotiation.cc:407] Connection header received
0811 01:01:31.245606 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:31.245607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:31.245619 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:31.245672 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:31.246727 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.247388 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.248384 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.248578 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.248639 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.250925 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:31.250927 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:31.250927 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:31.250944 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:31.252222 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:31.252619 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:31.252620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:31.252621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:31.252677 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:31.252904 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:31.252905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:31.252906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:31.253035 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:31.253092 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:31.253372 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 01:01:31.253490 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 01:01:31.253865 31360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.244645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:38305 (local address 127.13.30.130:54177)
0811 01:01:31.244831 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:31.244872 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:31.245508 (+ 636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:31.245745 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:31.245749 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:31.246434 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:31.246634 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.246639 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.247476 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.247476 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.248294 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.248297 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.248656 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.248657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.248806 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.249338 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:31.249348 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:31.250825 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:31.252301 (+ 1476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:31.252309 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:31.252311 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:31.252549 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:31.252735 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:31.252736 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:31.252736 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:31.252848 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:31.253095 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:31.253103 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:31.253250 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 01:01:31.253340 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 01:01:31.253552 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":99,"threads_started":1}
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
I20260811 01:01:31.254333 31358 heartbeater.cc:347] Connected to a master server at 127.13.30.190:38305
I20260811 01:01:31.254447 31358 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:31.254648 31358 heartbeater.cc:511] Master 127.13.30.190:38305 requested a full tablet report, sending...
I20260811 01:01:31.255038 30851 ts_manager.cc:194] Registered new tserver with Master: 767cf81ac05c4779970d0357ebb84ac0 (127.13.30.130:33675)
I20260811 01:01:31.255510 30851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:54177
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:01:31.272395 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:38305
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:46563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:01:31.358552 31365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:01:31.358783 31365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:01:31.358822 31365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:01:31.360136 31365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:01:31.360193 31365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:01:31.360232 31365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:01:31.361932 31365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:46563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:38305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:01:31.362203 31365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:01:31.362478 31365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:01:31.367744 31375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:31.367745 31370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:01:31.367744 31372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:01:31.367990 31365 server_base.cc:1034] running on GCE node
I20260811 01:01:31.368202 31365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:01:31.368449 31365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:01:31.369596 31365 hybrid_clock.cc:648] HybridClock initialized: now 1786410091369580 us; error 34 us; skew 500 ppm
Aug 11 01:01:31 dist-test-slave-42z9 krb5kdc[30762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410091, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:01:31.372066 31365 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:01:31.372524 31365 webserver.cc:460] Webserver started at http://127.13.30.131:43623/ using document root <none> and password file <none>
I20260811 01:01:31.372766 31365 fs_manager.cc:359] Metadata directory not provided
I20260811 01:01:31.372816 31365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:01:31.372948 31365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:01:31.374109 31365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "bd71275def324db0aedceceb80b08590"
format_stamp: "Formatted at 2026-08-11 01:01:31 on dist-test-slave-42z9"
server_key: "195553f21640cfe08466bb1374bd22fe"
server_key_iv: "eb39bb7f372ba54c464c42d59aec3015"
server_key_version: "encryptionkey@0"
I20260811 01:01:31.374454 31365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "bd71275def324db0aedceceb80b08590"
format_stamp: "Formatted at 2026-08-11 01:01:31 on dist-test-slave-42z9"
server_key: "195553f21640cfe08466bb1374bd22fe"
server_key_iv: "eb39bb7f372ba54c464c42d59aec3015"
server_key_version: "encryptionkey@0"
I20260811 01:01:31.375748 31365 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:01:31.376420 31382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:31.376588 31365 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:01:31.376672 31365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "bd71275def324db0aedceceb80b08590"
format_stamp: "Formatted at 2026-08-11 01:01:31 on dist-test-slave-42z9"
server_key: "195553f21640cfe08466bb1374bd22fe"
server_key_iv: "eb39bb7f372ba54c464c42d59aec3015"
server_key_version: "encryptionkey@0"
I20260811 01:01:31.376735 31365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:01:31.398854 31365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:01:31.401161 31365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:01:31.401317 31365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:01:31.401634 31365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:01:31.401968 31365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:01:31.402005 31365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:31.402034 31365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:01:31.402057 31365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:01:31.407927 31365 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:45267
I20260811 01:01:31.408002 31571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:45267 every 8 connection(s)
I20260811 01:01:31.408313 31365 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:01:31.408588 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 31365
I20260811 01:01:31.408684 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:01:31.408890 13434 external_mini_cluster.cc:1428] Setting key 337f79d83c6ae5caae4c91395e9708d4
Aug 11 01:01:31 dist-test-slave-42z9 krb5kdc[30762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410091, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:01:31.417798 30927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.409185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:53039 (local address 127.13.30.190:38305)
0811 01:01:31.409248 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:31.409251 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:31.409494 (+ 243us) server_negotiation.cc:407] Connection header received
0811 01:01:31.410092 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:31.410093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:31.410105 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:31.410149 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:31.411188 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.411699 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.412777 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.413028 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.413143 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.415401 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:31.415404 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:31.415404 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:31.415413 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:31.416578 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:31.416946 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:31.416946 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:31.416947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:31.417040 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:31.417225 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:31.417225 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:31.417225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:31.417334 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:31.417379 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:31.417657 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 01:01:31.417728 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 01:01:31.417979 31575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.409179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:38305 (local address 127.13.30.131:53039)
0811 01:01:31.409349 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:31.409401 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:31.410004 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:31.410236 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:31.410240 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:31.410825 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:01:31.411088 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.411096 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.411782 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.411783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.412615 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.412617 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.413153 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.413154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.413265 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.413857 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:01:31.413866 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:01:31.415274 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:01:31.416650 (+ 1376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:31.416656 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:31.416658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:31.416887 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:31.417088 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:01:31.417088 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:01:31.417089 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:01:31.417181 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:01:31.417377 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:01:31.417381 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:01:31.417548 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 01:01:31.417634 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 01:01:31.417768 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":86,"threads_started":1}
I20260811 01:01:31.418416 31572 heartbeater.cc:347] Connected to a master server at 127.13.30.190:38305
I20260811 01:01:31.418511 31572 heartbeater.cc:464] Registering TS with master...
I20260811 01:01:31.418681 31572 heartbeater.cc:511] Master 127.13.30.190:38305 requested a full tablet report, sending...
I20260811 01:01:31.419026 30851 ts_manager.cc:194] Registered new tserver with Master: bd71275def324db0aedceceb80b08590 (127.13.30.131:45267)
I20260811 01:01:31.419400 30851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:53039
I20260811 01:01:31.420547 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:01:31.427733 30927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.421835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40804 (local address 127.13.30.190:38305)
0811 01:01:31.421895 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:31.421898 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:31.421998 (+ 100us) server_negotiation.cc:407] Connection header received
0811 01:01:31.422063 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:31.422063 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:31.422074 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:31.422118 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:01:31.422641 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.423128 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.423823 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.424010 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.424066 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.425157 (+ 1091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:01:31.425159 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:01:31.425159 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:01:31.425165 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:01:31.426543 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:31.426930 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:31.426931 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:31.426932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:31.426986 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:01:31.427151 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:01:31.427151 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:01:31.427152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:01:31.427340 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:01:31.427434 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:31.427558 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 01:01:31.427641 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 01:01:31.429283 30851 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40804:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:01:31.430897 30851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:01:31.437397 31594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.433172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:45267 (local address 127.0.0.1:49846)
0811 01:01:31.433603 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:31.433612 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:31.433667 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:31.433853 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:31.433857 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:31.433859 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:31.434001 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.434004 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.434968 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.434969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.436095 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.436098 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.437065 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.437066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.437154 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.437169 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 01:01:31.437240 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 01:01:31.437299 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":93,"threads_started":1}
I20260811 01:01:31.437409 31593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.433288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49846 (local address 127.13.30.131:45267)
0811 01:01:31.433519 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:31.433525 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:31.433683 (+ 158us) server_negotiation.cc:407] Connection header received
0811 01:01:31.433736 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:31.433738 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:31.433755 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:31.433824 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:31.434083 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.434865 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.436193 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.436978 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.437056 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.437119 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:31.437271 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 01:01:31.437316 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":93,"threads_started":1}
I20260811 01:01:31.437551 31590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.433171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:44345 (local address 127.0.0.1:39146)
0811 01:01:31.433384 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:31.433426 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:31.433530 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:31.433989 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:31.433989 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:31.433991 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:31.434058 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.434059 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.435456 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.435457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.436428 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.436431 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.437309 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.437310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.437378 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.437382 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:01:31.437412 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 01:01:31.437481 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":2,"thread_start_us":71,"threads_started":1}
I20260811 01:01:31.437920 31592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.433282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39146 (local address 127.13.30.129:44345)
0811 01:01:31.433812 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:31.433816 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:31.433828 (+ 12us) server_negotiation.cc:407] Connection header received
0811 01:01:31.433869 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:31.433871 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:31.433886 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:31.434133 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:31.434212 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.435345 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.436509 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.437204 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.437723 (+ 519us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.437795 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:31.437819 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 01:01:31.437856 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":84,"threads_started":1}
I20260811 01:01:31.438262 31470 tablet_service.cc:1467] Processing CreateTablet for tablet 7d55b19b734e42a1ae6b710b65f1fa6c (DEFAULT_TABLE table=test-table [id=86e789768b2e4a308989e7f5b7979f15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:31.438493 31053 tablet_service.cc:1467] Processing CreateTablet for tablet 7d55b19b734e42a1ae6b710b65f1fa6c (DEFAULT_TABLE table=test-table [id=86e789768b2e4a308989e7f5b7979f15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:31.438674 31470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d55b19b734e42a1ae6b710b65f1fa6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:31.438841 31053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d55b19b734e42a1ae6b710b65f1fa6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:31.439137 31589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.433424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:33675 (local address 127.0.0.1:51112)
0811 01:01:31.433627 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:31.433635 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:31.433698 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:31.433987 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:31.433988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:31.433991 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:31.434124 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.434126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.436544 (+ 2418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.436545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.438000 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.438003 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.438927 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.438928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.438992 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.438997 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:01:31.439024 (+ 27us) client_negotiation.cc:240] Negotiation successful
0811 01:01:31.439069 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":91,"thread_start_us":108,"threads_started":1}
I20260811 01:01:31.439539 31597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.433606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51112 (local address 127.13.30.130:33675)
0811 01:01:31.433821 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:31.433825 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:31.433834 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:31.433870 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:31.433872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:31.433886 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:31.434202 (+ 316us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:31.434275 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.435344 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.438099 (+ 2755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.438826 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.439318 (+ 492us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.439388 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:31.439416 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 01:01:31.439461 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":88,"threads_started":1}
I20260811 01:01:31.442088 31598 tablet_bootstrap.cc:492] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590: Bootstrap starting.
I20260811 01:01:31.442153 31255 tablet_service.cc:1467] Processing CreateTablet for tablet 7d55b19b734e42a1ae6b710b65f1fa6c (DEFAULT_TABLE table=test-table [id=86e789768b2e4a308989e7f5b7979f15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:01:31.442492 31601 tablet_bootstrap.cc:492] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf: Bootstrap starting.
I20260811 01:01:31.442531 31255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d55b19b734e42a1ae6b710b65f1fa6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:01:31.442783 31598 tablet_bootstrap.cc:654] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:31.443199 31601 tablet_bootstrap.cc:654] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:31.443252 31598 log.cc:824] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:31.443814 31601 log.cc:824] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:31.444085 31598 tablet_bootstrap.cc:492] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590: No bootstrap required, opened a new log
I20260811 01:01:31.444166 31598 ts_tablet_manager.cc:1397] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:01:31.444585 31601 tablet_bootstrap.cc:492] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf: No bootstrap required, opened a new log
I20260811 01:01:31.444720 31601 ts_tablet_manager.cc:1397] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:01:31.446049 31606 tablet_bootstrap.cc:492] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0: Bootstrap starting.
I20260811 01:01:31.445858 31598 raft_consensus.cc:348] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ef793ec8b944fe19a171358f9f2cddf" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44345 } } peers { permanent_uuid: "767cf81ac05c4779970d0357ebb84ac0" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 33675 } } peers { permanent_uuid: "bd71275def324db0aedceceb80b08590" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 45267 } }
I20260811 01:01:31.446214 31598 raft_consensus.cc:374] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:31.446425 31598 raft_consensus.cc:729] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd71275def324db0aedceceb80b08590, State: Initialized, Role: FOLLOWER
I20260811 01:01:31.446573 31598 consensus_queue.cc:260] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ef793ec8b944fe19a171358f9f2cddf" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44345 } } peers { permanent_uuid: "767cf81ac05c4779970d0357ebb84ac0" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 33675 } } peers { permanent_uuid: "bd71275def324db0aedceceb80b08590" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 45267 } }
I20260811 01:01:31.446776 31606 tablet_bootstrap.cc:654] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0: Neither blocks nor log segments found. Creating new log.
I20260811 01:01:31.446883 31598 ts_tablet_manager.cc:1428] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:01:31.446838 31601 raft_consensus.cc:348] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ef793ec8b944fe19a171358f9f2cddf" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44345 } } peers { permanent_uuid: "767cf81ac05c4779970d0357ebb84ac0" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 33675 } } peers { permanent_uuid: "bd71275def324db0aedceceb80b08590" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 45267 } }
I20260811 01:01:31.446972 31572 heartbeater.cc:503] Master 127.13.30.190:38305 was elected leader, sending a full tablet report...
I20260811 01:01:31.447006 31601 raft_consensus.cc:374] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:31.447046 31601 raft_consensus.cc:729] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ef793ec8b944fe19a171358f9f2cddf, State: Initialized, Role: FOLLOWER
I20260811 01:01:31.447163 31601 consensus_queue.cc:260] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ef793ec8b944fe19a171358f9f2cddf" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44345 } } peers { permanent_uuid: "767cf81ac05c4779970d0357ebb84ac0" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 33675 } } peers { permanent_uuid: "bd71275def324db0aedceceb80b08590" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 45267 } }
I20260811 01:01:31.447355 31606 log.cc:824] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0: Log is configured to *not* fsync() on all Append() calls
I20260811 01:01:31.447431 31601 ts_tablet_manager.cc:1428] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 01:01:31.447575 31158 heartbeater.cc:503] Master 127.13.30.190:38305 was elected leader, sending a full tablet report...
I20260811 01:01:31.448179 31606 tablet_bootstrap.cc:492] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0: No bootstrap required, opened a new log
I20260811 01:01:31.448258 31606 ts_tablet_manager.cc:1397] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:01:31.449842 31606 raft_consensus.cc:348] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ef793ec8b944fe19a171358f9f2cddf" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44345 } } peers { permanent_uuid: "767cf81ac05c4779970d0357ebb84ac0" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 33675 } } peers { permanent_uuid: "bd71275def324db0aedceceb80b08590" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 45267 } }
I20260811 01:01:31.449992 31606 raft_consensus.cc:374] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:01:31.450014 31606 raft_consensus.cc:729] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 767cf81ac05c4779970d0357ebb84ac0, State: Initialized, Role: FOLLOWER
I20260811 01:01:31.450101 31606 consensus_queue.cc:260] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ef793ec8b944fe19a171358f9f2cddf" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44345 } } peers { permanent_uuid: "767cf81ac05c4779970d0357ebb84ac0" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 33675 } } peers { permanent_uuid: "bd71275def324db0aedceceb80b08590" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 45267 } }
I20260811 01:01:31.450335 31606 ts_tablet_manager.cc:1428] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:01:31.450389 31358 heartbeater.cc:503] Master 127.13.30.190:38305 was elected leader, sending a full tablet report...
W20260811 01:01:31.494556 31359 tablet.cc:2369] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:01:31.581808 31161 tablet.cc:2369] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:01:31.625339 31612 raft_consensus.cc:482] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:01:31.625519 31612 raft_consensus.cc:504] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ef793ec8b944fe19a171358f9f2cddf" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44345 } } peers { permanent_uuid: "767cf81ac05c4779970d0357ebb84ac0" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 33675 } } peers { permanent_uuid: "bd71275def324db0aedceceb80b08590" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 45267 } }
I20260811 01:01:31.625900 31612 leader_election.cc:288] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ef793ec8b944fe19a171358f9f2cddf (127.13.30.129:44345), bd71275def324db0aedceceb80b08590 (127.13.30.131:45267)
I20260811 01:01:31.629882 31360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.626110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:44345 (local address 127.13.30.130:59793)
0811 01:01:31.626186 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:31.626198 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:31.626243 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:31.626421 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:31.626423 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:31.626425 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:31.626501 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.626503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.627414 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.627416 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.628685 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.628688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.629538 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.629539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.629640 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.629647 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 01:01:31.629711 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 01:01:31.629763 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":13}
I20260811 01:01:31.629947 31592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.626196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:59793 (local address 127.13.30.129:44345)
0811 01:01:31.626268 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:31.626270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:31.626299 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:01:31.626330 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:31.626331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:31.626340 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:31.626400 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:31.626569 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.627326 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.628816 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.629408 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.629533 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.629542 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:31.629817 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 01:01:31.629871 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 01:01:31.629889 31614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.626134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:45267 (local address 127.13.30.130:60315)
0811 01:01:31.626323 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:31.626334 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:01:31.626406 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:01:31.626530 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:01:31.626530 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:01:31.626532 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:01:31.626587 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.626588 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.627463 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.627464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.628685 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:01:31.628688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.629566 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.629567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:01:31.629640 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.629647 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 01:01:31.629711 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 01:01:31.629763 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":8,"thread_start_us":102,"threads_started":1}
I20260811 01:01:31.629963 31593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.626312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:60315 (local address 127.13.30.131:45267)
0811 01:01:31.626383 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:31.626385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:31.626394 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:01:31.626466 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:31.626467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:31.626475 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:31.626515 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:01:31.626649 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.627379 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.628820 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.629408 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.629531 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.629542 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:31.629818 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 01:01:31.629871 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 01:01:31.630298 31081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d55b19b734e42a1ae6b710b65f1fa6c" candidate_uuid: "767cf81ac05c4779970d0357ebb84ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ef793ec8b944fe19a171358f9f2cddf" is_pre_election: true
I20260811 01:01:31.630295 31504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d55b19b734e42a1ae6b710b65f1fa6c" candidate_uuid: "767cf81ac05c4779970d0357ebb84ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd71275def324db0aedceceb80b08590" is_pre_election: true
I20260811 01:01:31.630462 31504 raft_consensus.cc:2454] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 767cf81ac05c4779970d0357ebb84ac0 in term 0.
I20260811 01:01:31.630461 31081 raft_consensus.cc:2454] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 767cf81ac05c4779970d0357ebb84ac0 in term 0.
I20260811 01:01:31.630733 31194 leader_election.cc:302] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 767cf81ac05c4779970d0357ebb84ac0, bd71275def324db0aedceceb80b08590; no voters:
I20260811 01:01:31.630861 31612 raft_consensus.cc:2781] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:01:31.630923 31612 raft_consensus.cc:482] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:01:31.630944 31612 raft_consensus.cc:3037] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:31.631744 31612 raft_consensus.cc:504] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ef793ec8b944fe19a171358f9f2cddf" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44345 } } peers { permanent_uuid: "767cf81ac05c4779970d0357ebb84ac0" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 33675 } } peers { permanent_uuid: "bd71275def324db0aedceceb80b08590" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 45267 } }
I20260811 01:01:31.631887 31612 leader_election.cc:288] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [CANDIDATE]: Term 1 election: Requested vote from peers 5ef793ec8b944fe19a171358f9f2cddf (127.13.30.129:44345), bd71275def324db0aedceceb80b08590 (127.13.30.131:45267)
I20260811 01:01:31.632071 31081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d55b19b734e42a1ae6b710b65f1fa6c" candidate_uuid: "767cf81ac05c4779970d0357ebb84ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ef793ec8b944fe19a171358f9f2cddf"
I20260811 01:01:31.632071 31504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d55b19b734e42a1ae6b710b65f1fa6c" candidate_uuid: "767cf81ac05c4779970d0357ebb84ac0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd71275def324db0aedceceb80b08590"
I20260811 01:01:31.632145 31504 raft_consensus.cc:3037] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:31.632148 31081 raft_consensus.cc:3037] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:01:31.632860 31081 raft_consensus.cc:2454] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 767cf81ac05c4779970d0357ebb84ac0 in term 1.
I20260811 01:01:31.632921 31504 raft_consensus.cc:2454] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 767cf81ac05c4779970d0357ebb84ac0 in term 1.
I20260811 01:01:31.633078 31195 leader_election.cc:302] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ef793ec8b944fe19a171358f9f2cddf, 767cf81ac05c4779970d0357ebb84ac0; no voters:
I20260811 01:01:31.633198 31612 raft_consensus.cc:2781] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:01:31.633366 31612 raft_consensus.cc:686] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [term 1 LEADER]: Becoming Leader. State: Replica: 767cf81ac05c4779970d0357ebb84ac0, State: Running, Role: LEADER
I20260811 01:01:31.633492 31612 consensus_queue.cc:237] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ef793ec8b944fe19a171358f9f2cddf" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44345 } } peers { permanent_uuid: "767cf81ac05c4779970d0357ebb84ac0" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 33675 } } peers { permanent_uuid: "bd71275def324db0aedceceb80b08590" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 45267 } }
I20260811 01:01:31.634344 30850 catalog_manager.cc:5495] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 767cf81ac05c4779970d0357ebb84ac0 (127.13.30.130). New cstate: current_term: 1 leader_uuid: "767cf81ac05c4779970d0357ebb84ac0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ef793ec8b944fe19a171358f9f2cddf" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "767cf81ac05c4779970d0357ebb84ac0" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 33675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd71275def324db0aedceceb80b08590" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 45267 } health_report { overall_health: UNKNOWN } } }
W20260811 01:01:31.659091 31573 tablet.cc:2369] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:01:31.667981 31597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.665543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51124 (local address 127.13.30.130:33675)
0811 01:01:31.665602 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 01:01:31.665604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:01:31.665612 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:01:31.665661 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:01:31.665662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:01:31.665683 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:01:31.665748 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:01:31.665905 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.666401 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.667157 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:01:31.667384 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:01:31.667444 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:01:31.667606 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:01:31.667722 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:01:31.667799 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 01:01:31.667843 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 01:01:31.667869 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 01:01:31.670020 31504 raft_consensus.cc:1261] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590 [term 1 FOLLOWER]: Refusing update from remote peer 767cf81ac05c4779970d0357ebb84ac0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:31.670020 31081 raft_consensus.cc:1261] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf [term 1 FOLLOWER]: Refusing update from remote peer 767cf81ac05c4779970d0357ebb84ac0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:01:31.670405 31612 consensus_queue.cc:1035] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ef793ec8b944fe19a171358f9f2cddf" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:31.670573 31618 consensus_queue.cc:1035] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd71275def324db0aedceceb80b08590" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:01:31.672914 31622 mvcc.cc:205] Tried to move back new op lower bound from 7317135735477420032 to 7317135735331328000. Current Snapshot: MvccSnapshot[applied={T|T < 7317135735477420032}]
I20260811 01:01:31.673935 31627 mvcc.cc:205] Tried to move back new op lower bound from 7317135735477420032 to 7317135735331328000. Current Snapshot: MvccSnapshot[applied={T|T < 7317135735477420032 or (T in {7317135735477420032})}]
I20260811 01:01:31.676529 30846 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:01:31.676649 30846 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:01:31.677502 30846 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3042e95eaa814031b81112be2a4b1aee: Sending DeleteTablet for 3 replicas of tablet 7d55b19b734e42a1ae6b710b65f1fa6c
I20260811 01:01:31.677873 31053 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d55b19b734e42a1ae6b710b65f1fa6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:31 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:39146
I20260811 01:01:31.677918 31470 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d55b19b734e42a1ae6b710b65f1fa6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:31 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:49846
I20260811 01:01:31.678151 31255 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d55b19b734e42a1ae6b710b65f1fa6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:01:31 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:51112
I20260811 01:01:31.678407 31643 tablet_replica.cc:330] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0: stopping tablet replica
I20260811 01:01:31.678526 31641 tablet_replica.cc:330] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf: stopping tablet replica
I20260811 01:01:31.678689 31641 raft_consensus.cc:2229] T 7d55b19b734e42a1ae6b710b65f1fa6c P 5ef793ec8b944fe19a171358f9f2cddf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:31.678717 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 30946
I20260811 01:01:31.678803 31643 raft_consensus.cc:2229] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:01:31.696089 31643 raft_consensus.cc:2258] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:31.696291 31642 tablet_replica.cc:330] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590: stopping tablet replica
I20260811 01:01:31.696547 31642 raft_consensus.cc:2229] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:01:31.696719 31642 raft_consensus.cc:2258] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:01:31.698218 31643 ts_tablet_manager.cc:1905] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:31.698311 31642 ts_tablet_manager.cc:1905] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:01:31.700223 31642 ts_tablet_manager.cc:1918] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:01:31.700230 31643 ts_tablet_manager.cc:1918] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:01:31.700320 31643 log.cc:1196] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/7d55b19b734e42a1ae6b710b65f1fa6c
I20260811 01:01:31.700474 31642 log.cc:1196] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/7d55b19b734e42a1ae6b710b65f1fa6c
I20260811 01:01:31.700621 31643 ts_tablet_manager.cc:1939] T 7d55b19b734e42a1ae6b710b65f1fa6c P 767cf81ac05c4779970d0357ebb84ac0: Deleting consensus metadata
I20260811 01:01:31.700868 31642 ts_tablet_manager.cc:1939] T 7d55b19b734e42a1ae6b710b65f1fa6c P bd71275def324db0aedceceb80b08590: Deleting consensus metadata
I20260811 01:01:31.701205 30820 catalog_manager.cc:4841] TS 767cf81ac05c4779970d0357ebb84ac0 (127.13.30.130:33675): tablet 7d55b19b734e42a1ae6b710b65f1fa6c (table test-table [id=86e789768b2e4a308989e7f5b7979f15]) successfully deleted
I20260811 01:01:31.701483 30819 catalog_manager.cc:4841] TS bd71275def324db0aedceceb80b08590 (127.13.30.131:45267): tablet 7d55b19b734e42a1ae6b710b65f1fa6c (table test-table [id=86e789768b2e4a308989e7f5b7979f15]) successfully deleted
W20260811 01:01:31.703677 30820 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:44345 (error 108)
I20260811 01:01:31.704259 31589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:01:31.704128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:44345 (local address 127.0.0.1:39150)
0811 01:01:31.704181 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 01:01:31.704222 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:44345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 01:01:31.704345 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 31167
W20260811 01:01:31.711660 30820 catalog_manager.cc:4584] TS 5ef793ec8b944fe19a171358f9f2cddf (127.13.30.129:44345): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7d55b19b734e42a1ae6b710b65f1fa6c: Network error: Client connection negotiation failed: client connection to 127.13.30.129:44345: connect: Connection refused (error 111)
I20260811 01:01:31.716274 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 31365
I20260811 01:01:31.728502 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 30795
2026-08-11T01:01:31Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2303 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:01:31 dist-test-slave-42z9 krb5kdc[31654](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:01:31 dist-test-slave-42z9 krb5kdc[31654](info): set up 2 sockets
Aug 11 01:01:31 dist-test-slave-42z9 krb5kdc[31654](info): commencing operation
krb5kdc: starting...
W20260811 01:01:32.922595 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:01:33 dist-test-slave-42z9 krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:01:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:01:33Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.13.30.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.13.30.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/rangeradmin_127.13.30.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/rangeradmin_127.13.30.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.13.30.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.13.30.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/rangerlookup_127.13.30.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/rangerlookup_127.13.30.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.30.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.13.30.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/HTTP_127.13.30.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/HTTP_127.13.30.148@KRBTEST.COM.keytab.
I20260811 01:01:33.108736 13434 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task0Qaj6g/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/postgres -l logfile start
2026-08-11 01:01:35.782 UTC [31701] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 01:01:35.782 UTC [31701] LOG: listening on IPv4 address "127.13.30.148", port 59671
2026-08-11 01:01:35.785 UTC [31701] LOG: listening on Unix socket "/tmp/.s.PGSQL.59671"
2026-08-11 01:01:35.816 UTC [31705] LOG: database system was shut down at 2026-08-11 01:01:34 UTC
2026-08-11 01:01:35.820 UTC [31701] LOG: database system is ready to accept connections
I20260811 01:01:36.902602 13434 mini_postgres.cc:96] Postgres bound to 59671
2026-08-11 01:01:36.910 UTC [31715] FATAL: database "slave" does not exist
127.13.30.148:59671 - accepting connections
I20260811 01:01:36.911938 13434 mini_ranger.cc:161] Starting Ranger...
I20260811 01:01:36.928978 13434 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 01:01:37.473901 13434 mini_ranger.cc:87] Created ranger Postgres database
I20260811 01:01:37.473986 13434 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-admin
2026-08-11 01:01:37,882 [I] DB FLAVOR :POSTGRES
2026-08-11 01:01:37,883 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 01:01:37,883 [I] Checking connection..
2026-08-11 01:01:37,883 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 01:01:38,176 [I] Checking connection passed.
2026-08-11 01:01:38,176 [I] --------- Verifying version history table ---------
2026-08-11 01:01:38,176 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:01:38,464 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 01:01:38,465 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:01:38,737 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 01:01:38,737 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 01:01:38,738 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 01:01:39.007 UTC [31826] WARNING: there is no transaction in progress
2026-08-11 01:01:39,014 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 01:01:39,015 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:01:39,292 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 01:01:39,292 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 01:01:39,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 01:01:39,551 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 01:01:39,837 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-42z9.c.gcp-upstream.internal','N') ;"
2026-08-11 01:01:40,113 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 01:01:40,405 [I] Table x_portal_user does not exist in database ranger
2026-08-11 01:01:40,406 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 01:01:40,686 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 01:01:40,687 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 01:01:40,961 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 01:01:41,217 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 01:01:41,217 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 01:01:42.288 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.307 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.325 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.343 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.361 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.381 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.446 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.454 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.471 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.483 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.495 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.510 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.521 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.528 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.536 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:42.545 UTC [32009] WARNING: there is no transaction in progress
2026-08-11 01:01:43,310 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 01:01:43,310 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 01:01:43,574 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 01:01:43,574 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 01:01:43,842 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 01:01:43,842 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 01:01:44,112 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 01:01:44,112 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 01:01:44,375 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 01:01:44,637 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-42z9.c.gcp-upstream.internal';"
2026-08-11 01:01:44,908 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 01:01:44,908 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 01:01:45,191 [I] DB_PATCHES have already been applied
I20260811 01:01:45.197744 13434 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-admin:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task0Qaj6g/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 01:01:45.197824 13434 mini_ranger.cc:193] Using host: 127.13.30.148
I20260811 01:01:45.201978 13434 mini_ranger.cc:227] Ranger admin URL: http://127.13.30.148:50203
Aug 11, 2026 1:01:45 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 1:01:45 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 1:01:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 1:01:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 1:01:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 1:01:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 1:01:46 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 01:01:46.493925 13434 mini_ranger.cc:160] Time spent starting Ranger: real 9.582s user 0.000s sys 0.013s
Aug 11, 2026 1:02:10 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 1:02:10 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 1:02:10 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 1:02:10 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 1:02:10 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 1:02:10 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 1:02:10 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 1:02:10 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 1:02:10 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 1:02:10 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 1:02:10 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 1:02:10 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 1:02:10 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 1:02:10 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 1:02:10 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 1:02:10 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 1:02:10 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 1:02:11 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 01:02:12.096156 13434 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.13.30.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.13.30.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/rangerkms_127.13.30.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/rangerkms_127.13.30.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.30.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.13.30.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.30.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/HTTP_127.13.30.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.30.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/HTTP_127.13.30.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 01:02:12 dist-test-slave-42z9 krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410132, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 01:02:12.191593 13434 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 01:02:12.204409 13434 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 01:02:13.043960 13434 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 01:02:13.044050 13434 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-kms
I20260811 01:02:13.044061 13434 mini_ranger_kms.cc:227] Using postgres at 127.13.30.148:59671
2026-08-11 01:02:13,644 [I] DB FLAVOR :POSTGRES
2026-08-11 01:02:13,645 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 01:02:13,645 [I] Checking connection
2026-08-11 01:02:13,645 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 01:02:13,925 [I] connection success
2026-08-11 01:02:13,925 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 01:02:13,925 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 01:02:13,926 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 01:02:14,212 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 01:02:14,212 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 01:02:14,212 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 01:02:14,213 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:59671/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 01:02:14,506 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 01:02:15.059201 13434 mini_ranger_kms.cc:310] Created kms service
I20260811 01:02:15.300989 13434 mini_ranger_kms.cc:326] Created kudu user
I20260811 01:02:15.357384 13434 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 01:02:15 dist-test-slave-42z9 krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410132, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:02:15.828892 13434 mini_ranger_kms.cc:384] Added ranger policy
I20260811 01:02:15.829185 13434 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-kms:/tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 01:02:15.829207 13434 mini_ranger_kms.cc:240] Using host: 127.13.30.148
I20260811 01:02:15.833747 13434 mini_ranger_kms.cc:276] Ranger KMS PID: 32289
I20260811 01:02:15.833909 13434 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.13.30.148:45397
Aug 11, 2026 1:02:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 1:02:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 1:02:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 1:02:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 1:02:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 1:02:17 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 01:02:18 dist-test-slave-42z9 krb5kdc[31654](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786410138, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.30.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:02:18.321264 13434 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.130s user 0.008s sys 0.360s
I20260811 01:02:18.321389 13434 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 01:02:18.321499 13434 mini_ranger_kms.cc:401] 127.13.30.148:45397/kms/v1/keys
Aug 11 01:02:18 dist-test-slave-42z9 krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410138, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.30.148@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
Aug 11 01:02:19 dist-test-slave-42z9 krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410138, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.30.148@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
Aug 11 01:02:21 dist-test-slave-42z9 krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:02:21.764978 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:42377
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:42377
--ranger_config_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.30.148:45397/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:02:21.855041 32372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:02:21.855284 32372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:02:21.855309 32372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:02:21.856570 32372 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:02:21.856629 32372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:02:21.856642 32372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:02:21.856654 32372 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:02:21.856665 32372 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:02:21.858666 32372 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/wal
--ranger_kms_url=127.13.30.148:45397/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:42377
--ranger_config_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:42377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:02:21.858940 32372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:02:21.859193 32372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:02:21.864353 32389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:02:21.864346 32384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:02:21.864346 32382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:02:21.864702 32372 server_base.cc:1034] running on GCE node
I20260811 01:02:21.864974 32372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:02:21.865294 32372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:02:21.866482 32372 hybrid_clock.cc:648] HybridClock initialized: now 1786410141866464 us; error 34 us; skew 500 ppm
Aug 11 01:02:21 dist-test-slave-42z9 krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410141, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:02:21.869155 32372 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:02:21.869673 32372 webserver.cc:460] Webserver started at http://127.13.30.190:38077/ using document root <none> and password file <none>
I20260811 01:02:21.869875 32372 fs_manager.cc:359] Metadata directory not provided
I20260811 01:02:21.869916 32372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:02:21.870059 32372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:02:21 dist-test-slave-42z9 krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410141, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:02:21.930397 32372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "a99228caf52849868c23f9473bb72c2c"
format_stamp: "Formatted at 2026-08-11 01:02:21 on dist-test-slave-42z9"
server_key: "dfe9005d79cb9962bf8b4734d624ff86"
server_key_iv: "a450854ca3e42df8b36ae393e4c09709"
server_key_version: "kuduclusterkey@0"
I20260811 01:02:21.930933 32372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "a99228caf52849868c23f9473bb72c2c"
format_stamp: "Formatted at 2026-08-11 01:02:21 on dist-test-slave-42z9"
server_key: "dfe9005d79cb9962bf8b4734d624ff86"
server_key_iv: "a450854ca3e42df8b36ae393e4c09709"
server_key_version: "kuduclusterkey@0"
I20260811 01:02:21.932933 32372 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 01:02:21.946440 32400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:02:21.946733 32372 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:02:21.946863 32372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "a99228caf52849868c23f9473bb72c2c"
format_stamp: "Formatted at 2026-08-11 01:02:21 on dist-test-slave-42z9"
server_key: "dfe9005d79cb9962bf8b4734d624ff86"
server_key_iv: "a450854ca3e42df8b36ae393e4c09709"
server_key_version: "kuduclusterkey@0"
I20260811 01:02:21.946967 32372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:02:21.970314 32372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:02:21.972504 32372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:02:21.972677 32372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:02:21.978740 32372 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:42377
I20260811 01:02:21.978782 32485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:42377 every 8 connection(s)
I20260811 01:02:21.979251 32372 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:02:21.980123 32486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:02:21.982842 32486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c: Bootstrap starting.
I20260811 01:02:21.983115 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 32372
I20260811 01:02:21.983229 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:02:21.983417 13434 external_mini_cluster.cc:1428] Setting key f5c32a7753e1b34895a16d1efc0ed5ac
I20260811 01:02:21.984122 32486 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c: Neither blocks nor log segments found. Creating new log.
I20260811 01:02:21.984519 32486 log.cc:824] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:02:21.985428 32486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c: No bootstrap required, opened a new log
I20260811 01:02:21.988346 32486 raft_consensus.cc:348] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99228caf52849868c23f9473bb72c2c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42377 } }
I20260811 01:02:21.988554 32486 raft_consensus.cc:374] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:02:21.988590 32486 raft_consensus.cc:729] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99228caf52849868c23f9473bb72c2c, State: Initialized, Role: FOLLOWER
I20260811 01:02:21.988797 32486 consensus_queue.cc:260] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99228caf52849868c23f9473bb72c2c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42377 } }
I20260811 01:02:21.988907 32486 raft_consensus.cc:388] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:02:21.988962 32486 raft_consensus.cc:482] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:02:21.989018 32486 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:02:21.989898 32486 raft_consensus.cc:504] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99228caf52849868c23f9473bb72c2c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42377 } }
Aug 11 01:02:21 dist-test-slave-42z9 krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:02:21.990025 32486 leader_election.cc:302] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a99228caf52849868c23f9473bb72c2c; no voters:
I20260811 01:02:21.990262 32486 leader_election.cc:288] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:02:21.990324 32494 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:02:21.990603 32494 raft_consensus.cc:686] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [term 1 LEADER]: Becoming Leader. State: Replica: a99228caf52849868c23f9473bb72c2c, State: Running, Role: LEADER
I20260811 01:02:21.990679 32486 sys_catalog.cc:564] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:02:21.990813 32494 consensus_queue.cc:237] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99228caf52849868c23f9473bb72c2c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42377 } }
I20260811 01:02:21.991276 32494 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a99228caf52849868c23f9473bb72c2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99228caf52849868c23f9473bb72c2c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42377 } } }
I20260811 01:02:21.991431 32494 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [sys.catalog]: This master's current role is: LEADER
I20260811 01:02:21.991626 32494 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a99228caf52849868c23f9473bb72c2c. Latest consensus state: current_term: 1 leader_uuid: "a99228caf52849868c23f9473bb72c2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99228caf52849868c23f9473bb72c2c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42377 } } }
I20260811 01:02:21.991747 32494 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c [sys.catalog]: This master's current role is: LEADER
I20260811 01:02:21.991945 32508 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:02:21.992445 32486 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 01:02:21.992530 32508 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:02:21.998577 32492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:21.984053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52818 (local address 127.13.30.190:42377)
0811 01:02:21.984247 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 01:02:21.984256 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:02:21.984295 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:02:21.984875 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:02:21.984884 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:02:21.984934 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:02:21.985069 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:02:21.985779 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:21.986682 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:21.987433 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:21.987898 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:21.988005 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:21.990528 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:02:21.990533 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:02:21.990534 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:02:21.990550 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:02:21.992535 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:02:21.992981 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:02:21.992984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:02:21.992985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:02:21.993085 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:02:21.993320 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:02:21.993321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:02:21.993321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:02:21.993677 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:02:21.996849 (+ 3172us) server_negotiation.cc:1035] Waiting for connection context
0811 01:02:21.997192 (+ 343us) server_negotiation.cc:299] Negotiation successful
0811 01:02:21.998104 (+ 912us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":76,"threads_started":1}
I20260811 01:02:22.006142 32508 catalog_manager.cc:1347] Generated new cluster ID: 1301e9b1dfb64bdcbfab6ee3f0d033b5
I20260811 01:02:22.006232 32508 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:02:22.024740 32508 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:02:22.025732 32508 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:02:22.028712 32508 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c: Generated new TSK 0
I20260811 01:02:22.029055 32508 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:02:22.853708 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.30.148:45397/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42377
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:02:22.975765 32561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:02:22.976006 32561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:02:22.976046 32561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:02:22.977559 32561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:02:22.977618 32561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:02:22.977659 32561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:02:22.979449 32561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.13.30.148:45397/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:02:22.979750 32561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:02:22.980041 32561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:02:22.986022 32569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:02:22.986027 32573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:02:22.986085 32568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:02:22.986505 32561 server_base.cc:1034] running on GCE node
I20260811 01:02:22.986831 32561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:02:22.987232 32561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:02:22.990540 32561 hybrid_clock.cc:648] HybridClock initialized: now 1786410142990506 us; error 48 us; skew 500 ppm
Aug 11 01:02:22 dist-test-slave-42z9 krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410142, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:02:22.995244 32561 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:02:22.996021 32561 webserver.cc:460] Webserver started at http://127.13.30.129:37027/ using document root <none> and password file <none>
I20260811 01:02:22.996378 32561 fs_manager.cc:359] Metadata directory not provided
I20260811 01:02:22.996460 32561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:02:22.996616 32561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:02:22 dist-test-slave-42z9 krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410142, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:02:23.017493 32561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "f64573dc05c441f0bc87a4048dce548c"
format_stamp: "Formatted at 2026-08-11 01:02:23 on dist-test-slave-42z9"
server_key: "1ce31345f24c842290ef63ed1737428f"
server_key_iv: "21f85484541010dbe614d155d08b3a0e"
server_key_version: "kuduclusterkey@0"
I20260811 01:02:23.018275 32561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "f64573dc05c441f0bc87a4048dce548c"
format_stamp: "Formatted at 2026-08-11 01:02:23 on dist-test-slave-42z9"
server_key: "1ce31345f24c842290ef63ed1737428f"
server_key_iv: "21f85484541010dbe614d155d08b3a0e"
server_key_version: "kuduclusterkey@0"
I20260811 01:02:23.022084 32561 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260811 01:02:23.041648 32590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:02:23.041944 32561 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s
I20260811 01:02:23.042058 32561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "f64573dc05c441f0bc87a4048dce548c"
format_stamp: "Formatted at 2026-08-11 01:02:23 on dist-test-slave-42z9"
server_key: "1ce31345f24c842290ef63ed1737428f"
server_key_iv: "21f85484541010dbe614d155d08b3a0e"
server_key_version: "kuduclusterkey@0"
I20260811 01:02:23.042179 32561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:02:23.057300 32561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:02:23.059496 32561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:02:23.059702 32561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:02:23.059931 32561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:02:23.060348 32561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:02:23.060421 32561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:02:23.060549 32561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:02:23.060583 32561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:02:23.069078 32561 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:44025
I20260811 01:02:23.069144 319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:44025 every 8 connection(s)
I20260811 01:02:23.069785 32561 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:02:23.070812 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 32561
I20260811 01:02:23.070909 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:02:23.071113 13434 external_mini_cluster.cc:1428] Setting key 36c9396fd866ae08bac549c73d1d68a5
Aug 11 01:02:23 dist-test-slave-42z9 krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410142, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
I20260811 01:02:23.089514 326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.070659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42377 (local address 127.13.30.129:54675)
0811 01:02:23.070830 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 01:02:23.070878 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:02:23.071669 (+ 791us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:02:23.075915 (+ 4246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:02:23.075921 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:02:23.076227 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:02:23.076577 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.076586 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.077715 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.077716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.078992 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.078996 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.079585 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.079586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.079763 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.080480 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:02:23.080492 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:02:23.083508 (+ 3016us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:02:23.086090 (+ 2582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:02:23.086103 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:02:23.086106 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:02:23.086867 (+ 761us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:02:23.087340 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:02:23.087342 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:02:23.087342 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:02:23.087624 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:02:23.088177 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:02:23.088186 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:02:23.088520 (+ 334us) client_negotiation.cc:769] Sending connection context
0811 01:02:23.088712 (+ 192us) client_negotiation.cc:240] Negotiation successful
0811 01:02:23.089088 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":75,"threads_started":1}
I20260811 01:02:23.090603 327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.071332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:54675 (local address 127.13.30.190:42377)
0811 01:02:23.075578 (+ 4246us) server_negotiation.cc:206] Beginning negotiation
0811 01:02:23.075581 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:02:23.075595 (+ 14us) server_negotiation.cc:407] Connection header received
0811 01:02:23.075629 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:02:23.075629 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:02:23.075645 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:02:23.075752 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:02:23.076717 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.077599 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.079120 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.079465 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.083648 (+ 4183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.083727 (+ 79us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:02:23.083728 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:02:23.083729 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:02:23.083734 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:02:23.085951 (+ 2217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:02:23.087066 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:02:23.087068 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:02:23.087068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:02:23.087193 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:02:23.087744 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:02:23.087745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:02:23.087745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:02:23.088009 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:02:23.090287 (+ 2278us) server_negotiation.cc:1035] Waiting for connection context
0811 01:02:23.090350 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 01:02:23.090491 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4180,"thread_start_us":74,"threads_started":1}
I20260811 01:02:23.093737 321 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42377
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
I20260811 01:02:23.093926 321 heartbeater.cc:464] Registering TS with master...
I20260811 01:02:23.094213 321 heartbeater.cc:511] Master 127.13.30.190:42377 requested a full tablet report, sending...
I20260811 01:02:23.096691 32432 ts_manager.cc:194] Registered new tserver with Master: f64573dc05c441f0bc87a4048dce548c (127.13.30.129:44025)
I20260811 01:02:23.097637 32432 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:54675
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:02:23.112509 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.30.148:45397/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42377
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:02:23 dist-test-slave-42z9 krb5kdc[31654](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786410143, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 01:02:23.255836 331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:02:23.256139 331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:02:23.256179 331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:02:23.258085 331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:02:23.258219 331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:02:23.258289 331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:02:23.260936 331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.13.30.148:45397/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:02:23.261264 331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:02:23.261684 331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:02:23.268534 343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:02:23.268795 344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:02:23.268906 347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:02:23.269143 331 server_base.cc:1034] running on GCE node
I20260811 01:02:23.269369 331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:02:23.269683 331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:02:23.270850 331 hybrid_clock.cc:648] HybridClock initialized: now 1786410143270827 us; error 40 us; skew 500 ppm
Aug 11 01:02:23 dist-test-slave-42z9 krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410143, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:02:23.274394 331 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:02:23.275036 331 webserver.cc:460] Webserver started at http://127.13.30.130:45647/ using document root <none> and password file <none>
I20260811 01:02:23.275350 331 fs_manager.cc:359] Metadata directory not provided
I20260811 01:02:23.275444 331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:02:23.275601 331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:02:23 dist-test-slave-42z9 krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410143, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:02:23.290902 331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "d20a97071f3e499d9c06e694d8592465"
format_stamp: "Formatted at 2026-08-11 01:02:23 on dist-test-slave-42z9"
server_key: "c440e451b0eb7bd4e81e524f08f577ae"
server_key_iv: "835423115f36daf08c1f73b9e48236e5"
server_key_version: "kuduclusterkey@0"
I20260811 01:02:23.291568 331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "d20a97071f3e499d9c06e694d8592465"
format_stamp: "Formatted at 2026-08-11 01:02:23 on dist-test-slave-42z9"
server_key: "c440e451b0eb7bd4e81e524f08f577ae"
server_key_iv: "835423115f36daf08c1f73b9e48236e5"
server_key_version: "kuduclusterkey@0"
I20260811 01:02:23.294934 331 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:02:23.314237 363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:02:23.320797 331 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.001s sys 0.000s
I20260811 01:02:23.320979 331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "d20a97071f3e499d9c06e694d8592465"
format_stamp: "Formatted at 2026-08-11 01:02:23 on dist-test-slave-42z9"
server_key: "c440e451b0eb7bd4e81e524f08f577ae"
server_key_iv: "835423115f36daf08c1f73b9e48236e5"
server_key_version: "kuduclusterkey@0"
I20260811 01:02:23.321112 331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:02:23.343572 331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:02:23.345615 331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:02:23.345773 331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:02:23.345988 331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:02:23.346459 331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:02:23.346585 331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:02:23.346716 331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:02:23.346805 331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:02:23.355295 331 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:45787
I20260811 01:02:23.358459 331 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:02:23.357898 567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:45787 every 8 connection(s)
I20260811 01:02:23.359840 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 331
I20260811 01:02:23.359946 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:02:23.360150 13434 external_mini_cluster.cc:1428] Setting key ee6ace7b9ac151fec234786522df5d84
Aug 11 01:02:23 dist-test-slave-42z9 krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410143, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:02:23.372412 327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.360336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:36177 (local address 127.13.30.190:42377)
0811 01:02:23.360416 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 01:02:23.360418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:02:23.361378 (+ 960us) server_negotiation.cc:407] Connection header received
0811 01:02:23.362194 (+ 816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:02:23.362195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:02:23.362211 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:02:23.362240 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:02:23.363178 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.363982 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.365536 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.365826 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.365873 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.368933 (+ 3060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:02:23.368935 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:02:23.368935 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:02:23.368945 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:02:23.370699 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:02:23.371263 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:02:23.371265 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:02:23.371265 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:02:23.371330 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:02:23.371630 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:02:23.371631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:02:23.371631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:02:23.371778 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:02:23.371818 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 01:02:23.372201 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 01:02:23.372306 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 01:02:23.373080 572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.360025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42377 (local address 127.13.30.130:36177)
0811 01:02:23.361235 (+ 1210us) negotiation.cc:107] Waiting for socket to connect
0811 01:02:23.361290 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 01:02:23.362068 (+ 778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:02:23.362431 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:02:23.362435 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:02:23.362759 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:02:23.363062 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.363070 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.364105 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.364106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.365390 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.365393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.365974 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.365975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.366258 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.366910 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:02:23.366921 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:02:23.368790 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:02:23.370815 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:02:23.370826 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:02:23.370829 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:02:23.371170 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:02:23.371398 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:02:23.371398 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:02:23.371399 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:02:23.371558 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:02:23.371861 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:02:23.371868 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:02:23.372046 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 01:02:23.372585 (+ 539us) client_negotiation.cc:240] Negotiation successful
0811 01:02:23.372777 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1156,"thread_start_us":94,"threads_started":1}
I20260811 01:02:23.373608 569 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42377
I20260811 01:02:23.373716 569 heartbeater.cc:464] Registering TS with master...
I20260811 01:02:23.373929 569 heartbeater.cc:511] Master 127.13.30.190:42377 requested a full tablet report, sending...
I20260811 01:02:23.374321 32432 ts_manager.cc:194] Registered new tserver with Master: d20a97071f3e499d9c06e694d8592465 (127.13.30.130:45787)
I20260811 01:02:23.374840 32432 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:36177
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:02:23.418977 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.30.148:45397/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42377
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:02:23.552325 578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:02:23.552762 578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:02:23.552865 578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:02:23.555027 578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:02:23.555202 578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:02:23.555296 578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:02:23.558876 578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.13.30.148:45397/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:02:23.559551 578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:02:23.559954 578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:02:23.566448 595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:02:23.566741 588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:02:23.566880 589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:02:23.567199 578 server_base.cc:1034] running on GCE node
I20260811 01:02:23.567430 578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:02:23.567691 578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:02:23.568851 578 hybrid_clock.cc:648] HybridClock initialized: now 1786410143568835 us; error 29 us; skew 500 ppm
Aug 11 01:02:23 dist-test-slave-42z9 krb5kdc[31654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410143, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:02:23.571628 578 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:02:23.572155 578 webserver.cc:460] Webserver started at http://127.13.30.131:42269/ using document root <none> and password file <none>
I20260811 01:02:23.572422 578 fs_manager.cc:359] Metadata directory not provided
I20260811 01:02:23.572474 578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:02:23.572605 578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:02:23 dist-test-slave-42z9 krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410143, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:02:23.586170 578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "3c48a766644b4d9294999e2051e8adfd"
format_stamp: "Formatted at 2026-08-11 01:02:23 on dist-test-slave-42z9"
server_key: "a3115845c361f994db052c208999ed3c"
server_key_iv: "2e915257d6086f16da5d71b2b05e6a8f"
server_key_version: "kuduclusterkey@0"
I20260811 01:02:23.586977 578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "3c48a766644b4d9294999e2051e8adfd"
format_stamp: "Formatted at 2026-08-11 01:02:23 on dist-test-slave-42z9"
server_key: "a3115845c361f994db052c208999ed3c"
server_key_iv: "2e915257d6086f16da5d71b2b05e6a8f"
server_key_version: "kuduclusterkey@0"
I20260811 01:02:23.590201 578 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:02:23.604773 606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:02:23.604982 578 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:02:23.605068 578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "3c48a766644b4d9294999e2051e8adfd"
format_stamp: "Formatted at 2026-08-11 01:02:23 on dist-test-slave-42z9"
server_key: "a3115845c361f994db052c208999ed3c"
server_key_iv: "2e915257d6086f16da5d71b2b05e6a8f"
server_key_version: "kuduclusterkey@0"
I20260811 01:02:23.605168 578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:02:23.638159 578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:02:23.640872 578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:02:23.641156 578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:02:23.641531 578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:02:23.642012 578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:02:23.642115 578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:02:23.642198 578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:02:23.642256 578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:02:23.651924 578 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:44049
I20260811 01:02:23.652187 800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:44049 every 8 connection(s)
I20260811 01:02:23.652536 578 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:02:23.658797 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 578
I20260811 01:02:23.658907 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:02:23.659127 13434 external_mini_cluster.cc:1428] Setting key 893b726fe94bd3bef12f060aa3b3c716
Aug 11 01:02:23 dist-test-slave-42z9 krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410143, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:02:23.666706 327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.653550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:51117 (local address 127.13.30.190:42377)
0811 01:02:23.653598 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 01:02:23.653601 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:02:23.654120 (+ 519us) server_negotiation.cc:407] Connection header received
0811 01:02:23.654856 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:02:23.654858 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:02:23.654872 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:02:23.654904 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:02:23.655811 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.656557 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.658156 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.658474 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.658525 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.663073 (+ 4548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:02:23.663075 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:02:23.663076 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:02:23.663085 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:02:23.664782 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:02:23.665362 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:02:23.665364 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:02:23.665364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:02:23.665471 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:02:23.665787 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:02:23.665788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:02:23.665788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:02:23.665949 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:02:23.666003 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 01:02:23.666502 (+ 499us) server_negotiation.cc:299] Negotiation successful
0811 01:02:23.666600 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 01:02:23.667681 804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.653421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42377 (local address 127.13.30.131:51117)
0811 01:02:23.653963 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0811 01:02:23.654021 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 01:02:23.654725 (+ 704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:02:23.655107 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:02:23.655111 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:02:23.655381 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:02:23.655692 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.655700 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.656692 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.656693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.658042 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.658045 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.660233 (+ 2188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.660234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.660426 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.661051 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:02:23.661063 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:02:23.662935 (+ 1872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:02:23.664897 (+ 1962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:02:23.664910 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:02:23.664913 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:02:23.665262 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:02:23.665549 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:02:23.665550 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:02:23.665550 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:02:23.665704 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:02:23.666045 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:02:23.666053 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:02:23.666300 (+ 247us) client_negotiation.cc:769] Sending connection context
0811 01:02:23.667141 (+ 841us) client_negotiation.cc:240] Negotiation successful
0811 01:02:23.667392 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":147,"threads_started":1}
I20260811 01:02:23.668378 802 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42377
I20260811 01:02:23.668503 802 heartbeater.cc:464] Registering TS with master...
I20260811 01:02:23.668720 802 heartbeater.cc:511] Master 127.13.30.190:42377 requested a full tablet report, sending...
I20260811 01:02:23.669183 32432 ts_manager.cc:194] Registered new tserver with Master: 3c48a766644b4d9294999e2051e8adfd (127.13.30.131:44049)
I20260811 01:02:23.669744 32432 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:51117
I20260811 01:02:23.671319 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:02:23.694842 327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.684891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52826 (local address 127.13.30.190:42377)
0811 01:02:23.684949 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 01:02:23.684951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:02:23.685332 (+ 381us) server_negotiation.cc:407] Connection header received
0811 01:02:23.685487 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:02:23.685488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:02:23.685501 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:02:23.685536 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:02:23.686425 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.687174 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.689560 (+ 2386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.689876 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.689918 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.691673 (+ 1755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:02:23.691675 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:02:23.691676 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:02:23.691685 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:02:23.693425 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:02:23.693884 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:02:23.693886 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:02:23.693886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:02:23.693950 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:02:23.694153 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:02:23.694154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:02:23.694155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:02:23.694301 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:02:23.694381 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 01:02:23.694645 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 01:02:23.694736 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 01:02:23.698897 32432 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52826:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:02:23.701354 32432 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:02:23.739084 828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.707983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:45787 (local address 127.0.0.1:38122)
0811 01:02:23.712162 (+ 4179us) negotiation.cc:107] Waiting for socket to connect
0811 01:02:23.712173 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:02:23.712227 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:02:23.712588 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:02:23.712591 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:02:23.712594 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:02:23.712682 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.712684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.714055 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.714056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.722234 (+ 8178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.736139 (+ 13905us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.738664 (+ 2525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.738666 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.738800 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.738820 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 01:02:23.738910 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 01:02:23.738985 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4155,"thread_start_us":124,"threads_started":1}
I20260811 01:02:23.739630 830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.708574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38122 (local address 127.13.30.130:45787)
0811 01:02:23.710082 (+ 1508us) server_negotiation.cc:206] Beginning negotiation
0811 01:02:23.710088 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:02:23.712293 (+ 2205us) server_negotiation.cc:407] Connection header received
0811 01:02:23.712348 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:02:23.712351 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:02:23.712369 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:02:23.712460 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:02:23.712774 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.713944 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.736303 (+ 22359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.737266 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.737352 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.739446 (+ 2094us) server_negotiation.cc:1035] Waiting for connection context
0811 01:02:23.739493 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 01:02:23.739550 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1460,"thread_start_us":100,"threads_started":1}
I20260811 01:02:23.740284 826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.708209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:44025 (local address 127.0.0.1:43168)
0811 01:02:23.728428 (+ 20219us) negotiation.cc:107] Waiting for socket to connect
0811 01:02:23.728457 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 01:02:23.728528 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:02:23.729835 (+ 1307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:02:23.729836 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:02:23.729839 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:02:23.729898 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.729899 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.732219 (+ 2320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.732220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.733520 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.733525 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.740033 (+ 6508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.740034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.740111 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.740116 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:02:23.740162 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:02:23.740213 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20181,"thread_start_us":65,"threads_started":1}
I20260811 01:02:23.740700 831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.708763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43168 (local address 127.13.30.129:44025)
0811 01:02:23.710154 (+ 1391us) server_negotiation.cc:206] Beginning negotiation
0811 01:02:23.710158 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:02:23.728604 (+ 18446us) server_negotiation.cc:407] Connection header received
0811 01:02:23.728654 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:02:23.728658 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:02:23.728676 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:02:23.728753 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:02:23.729988 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.731159 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.733633 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.734499 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.734581 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.734793 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0811 01:02:23.740544 (+ 5751us) server_negotiation.cc:299] Negotiation successful
0811 01:02:23.740614 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1363,"thread_start_us":62,"threads_started":1}
I20260811 01:02:23.742765 410 tablet_service.cc:1467] Processing CreateTablet for tablet 507e4acc443b457a87dfd6519d394afb (DEFAULT_TABLE table=test-table [id=4bebafb76ad548c9ab628ec7ec4f5dec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:02:23.743206 410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 507e4acc443b457a87dfd6519d394afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:02:23.743709 32658 tablet_service.cc:1467] Processing CreateTablet for tablet 507e4acc443b457a87dfd6519d394afb (DEFAULT_TABLE table=test-table [id=4bebafb76ad548c9ab628ec7ec4f5dec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:02:23.744076 32658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 507e4acc443b457a87dfd6519d394afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:02:23.747236 834 tablet_bootstrap.cc:492] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465: Bootstrap starting.
I20260811 01:02:23.748375 834 tablet_bootstrap.cc:654] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465: Neither blocks nor log segments found. Creating new log.
I20260811 01:02:23.741822 829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.707262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:44049 (local address 127.0.0.1:52572)
0811 01:02:23.710213 (+ 2951us) negotiation.cc:107] Waiting for socket to connect
0811 01:02:23.710264 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 01:02:23.710340 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:02:23.715026 (+ 4686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:02:23.715027 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:02:23.715031 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:02:23.715090 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.715092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.724251 (+ 9159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.724253 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.729725 (+ 5472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.729731 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.741556 (+ 11825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.741557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.741633 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.741638 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:02:23.741695 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 01:02:23.741749 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2915,"thread_start_us":89,"threads_started":1}
I20260811 01:02:23.748807 834 log.cc:824] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465: Log is configured to *not* fsync() on all Append() calls
I20260811 01:02:23.749234 835 tablet_bootstrap.cc:492] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c: Bootstrap starting.
I20260811 01:02:23.749410 827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.707630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52572 (local address 127.13.30.131:44049)
0811 01:02:23.714755 (+ 7125us) server_negotiation.cc:206] Beginning negotiation
0811 01:02:23.714761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:02:23.714774 (+ 13us) server_negotiation.cc:407] Connection header received
0811 01:02:23.714817 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:02:23.714819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:02:23.714838 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:02:23.714924 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:02:23.722951 (+ 8027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.724131 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.737586 (+ 13455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.741321 (+ 3735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.741402 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.741512 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 01:02:23.749173 (+ 7661us) server_negotiation.cc:299] Negotiation successful
0811 01:02:23.749248 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7075,"thread_start_us":102,"threads_started":1}
I20260811 01:02:23.750144 835 tablet_bootstrap.cc:654] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c: Neither blocks nor log segments found. Creating new log.
I20260811 01:02:23.750331 689 tablet_service.cc:1467] Processing CreateTablet for tablet 507e4acc443b457a87dfd6519d394afb (DEFAULT_TABLE table=test-table [id=4bebafb76ad548c9ab628ec7ec4f5dec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:02:23.750524 835 log.cc:824] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:02:23.750715 689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 507e4acc443b457a87dfd6519d394afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:02:23.751461 834 tablet_bootstrap.cc:492] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465: No bootstrap required, opened a new log
I20260811 01:02:23.751538 834 ts_tablet_manager.cc:1397] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 01:02:23.753958 834 raft_consensus.cc:348] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20a97071f3e499d9c06e694d8592465" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 45787 } } peers { permanent_uuid: "3c48a766644b4d9294999e2051e8adfd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 44049 } } peers { permanent_uuid: "f64573dc05c441f0bc87a4048dce548c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44025 } }
I20260811 01:02:23.754160 834 raft_consensus.cc:374] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:02:23.754199 834 raft_consensus.cc:729] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d20a97071f3e499d9c06e694d8592465, State: Initialized, Role: FOLLOWER
I20260811 01:02:23.754338 834 consensus_queue.cc:260] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20a97071f3e499d9c06e694d8592465" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 45787 } } peers { permanent_uuid: "3c48a766644b4d9294999e2051e8adfd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 44049 } } peers { permanent_uuid: "f64573dc05c441f0bc87a4048dce548c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44025 } }
I20260811 01:02:23.754690 834 ts_tablet_manager.cc:1428] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:02:23.754824 569 heartbeater.cc:503] Master 127.13.30.190:42377 was elected leader, sending a full tablet report...
I20260811 01:02:23.756515 835 tablet_bootstrap.cc:492] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c: No bootstrap required, opened a new log
I20260811 01:02:23.756603 835 ts_tablet_manager.cc:1397] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260811 01:02:23.759387 835 raft_consensus.cc:348] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20a97071f3e499d9c06e694d8592465" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 45787 } } peers { permanent_uuid: "3c48a766644b4d9294999e2051e8adfd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 44049 } } peers { permanent_uuid: "f64573dc05c441f0bc87a4048dce548c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44025 } }
I20260811 01:02:23.759593 835 raft_consensus.cc:374] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:02:23.759626 835 raft_consensus.cc:729] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f64573dc05c441f0bc87a4048dce548c, State: Initialized, Role: FOLLOWER
I20260811 01:02:23.759773 835 consensus_queue.cc:260] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20a97071f3e499d9c06e694d8592465" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 45787 } } peers { permanent_uuid: "3c48a766644b4d9294999e2051e8adfd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 44049 } } peers { permanent_uuid: "f64573dc05c441f0bc87a4048dce548c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44025 } }
I20260811 01:02:23.760066 835 ts_tablet_manager.cc:1428] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260811 01:02:23.760190 321 heartbeater.cc:503] Master 127.13.30.190:42377 was elected leader, sending a full tablet report...
I20260811 01:02:23.761144 841 tablet_bootstrap.cc:492] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd: Bootstrap starting.
I20260811 01:02:23.762444 841 tablet_bootstrap.cc:654] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd: Neither blocks nor log segments found. Creating new log.
I20260811 01:02:23.762882 841 log.cc:824] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd: Log is configured to *not* fsync() on all Append() calls
I20260811 01:02:23.765754 841 tablet_bootstrap.cc:492] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd: No bootstrap required, opened a new log
I20260811 01:02:23.765856 841 ts_tablet_manager.cc:1397] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260811 01:02:23.770361 841 raft_consensus.cc:348] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20a97071f3e499d9c06e694d8592465" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 45787 } } peers { permanent_uuid: "3c48a766644b4d9294999e2051e8adfd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 44049 } } peers { permanent_uuid: "f64573dc05c441f0bc87a4048dce548c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44025 } }
I20260811 01:02:23.770596 841 raft_consensus.cc:374] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:02:23.770637 841 raft_consensus.cc:729] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c48a766644b4d9294999e2051e8adfd, State: Initialized, Role: FOLLOWER
I20260811 01:02:23.770776 841 consensus_queue.cc:260] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20a97071f3e499d9c06e694d8592465" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 45787 } } peers { permanent_uuid: "3c48a766644b4d9294999e2051e8adfd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 44049 } } peers { permanent_uuid: "f64573dc05c441f0bc87a4048dce548c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44025 } }
I20260811 01:02:23.771144 841 ts_tablet_manager.cc:1428] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260811 01:02:23.771274 802 heartbeater.cc:503] Master 127.13.30.190:42377 was elected leader, sending a full tablet report...
Aug 11 01:02:23 dist-test-slave-42z9 krb5kdc[31654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410143, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
W20260811 01:02:23.820983 324 tablet.cc:2369] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:02:23.821535 848 raft_consensus.cc:482] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:02:23.821661 848 raft_consensus.cc:504] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20a97071f3e499d9c06e694d8592465" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 45787 } } peers { permanent_uuid: "3c48a766644b4d9294999e2051e8adfd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 44049 } } peers { permanent_uuid: "f64573dc05c441f0bc87a4048dce548c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44025 } }
I20260811 01:02:23.822075 848 leader_election.cc:288] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d20a97071f3e499d9c06e694d8592465 (127.13.30.130:45787), f64573dc05c441f0bc87a4048dce548c (127.13.30.129:44025)
I20260811 01:02:23.826386 804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.822443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:45787 (local address 127.13.30.131:50653)
0811 01:02:23.822515 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 01:02:23.822530 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:02:23.822601 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:02:23.823085 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:02:23.823086 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:02:23.823088 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:02:23.823166 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.823168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.824120 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.824121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.825279 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.825284 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.826091 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.826092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.826203 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.826208 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:02:23.826253 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 01:02:23.826300 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 01:02:23.826866 830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.822788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:50653 (local address 127.13.30.130:45787)
0811 01:02:23.822877 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 01:02:23.822879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:02:23.822888 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:02:23.822928 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:02:23.822929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:02:23.822940 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:02:23.822996 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:02:23.823243 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.823998 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.825403 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.825955 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.826041 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.826053 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 01:02:23.826746 (+ 693us) server_negotiation.cc:299] Negotiation successful
0811 01:02:23.826800 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:02:23.827224 486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507e4acc443b457a87dfd6519d394afb" candidate_uuid: "3c48a766644b4d9294999e2051e8adfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20a97071f3e499d9c06e694d8592465" is_pre_election: true
I20260811 01:02:23.827387 486 raft_consensus.cc:2454] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c48a766644b4d9294999e2051e8adfd in term 0.
I20260811 01:02:23.827756 612 leader_election.cc:302] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c48a766644b4d9294999e2051e8adfd, d20a97071f3e499d9c06e694d8592465; no voters:
I20260811 01:02:23.827961 848 raft_consensus.cc:2781] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:02:23.828029 848 raft_consensus.cc:482] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:02:23.828050 848 raft_consensus.cc:3037] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:02:23.829008 848 raft_consensus.cc:504] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20a97071f3e499d9c06e694d8592465" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 45787 } } peers { permanent_uuid: "3c48a766644b4d9294999e2051e8adfd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 44049 } } peers { permanent_uuid: "f64573dc05c441f0bc87a4048dce548c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44025 } }
I20260811 01:02:23.829160 848 leader_election.cc:288] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [CANDIDATE]: Term 1 election: Requested vote from peers d20a97071f3e499d9c06e694d8592465 (127.13.30.130:45787), f64573dc05c441f0bc87a4048dce548c (127.13.30.129:44025)
I20260811 01:02:23.829540 486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507e4acc443b457a87dfd6519d394afb" candidate_uuid: "3c48a766644b4d9294999e2051e8adfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20a97071f3e499d9c06e694d8592465"
I20260811 01:02:23.829653 486 raft_consensus.cc:3037] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:02:23.830122 804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.822548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:44025 (local address 127.13.30.131:36371)
0811 01:02:23.826487 (+ 3939us) negotiation.cc:107] Waiting for socket to connect
0811 01:02:23.826499 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:02:23.826547 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:02:23.827055 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:02:23.827056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:02:23.827058 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:02:23.827099 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.827101 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.828056 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.828057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.829079 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:02:23.829082 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.829879 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.829880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:02:23.829954 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.829958 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:02:23.830002 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 01:02:23.830048 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3927,"thread_start_us":97,"threads_started":1}
I20260811 01:02:23.830407 831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.822835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:36371 (local address 127.13.30.129:44025)
0811 01:02:23.823051 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 01:02:23.823053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:02:23.826648 (+ 3595us) server_negotiation.cc:407] Connection header received
0811 01:02:23.826683 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:02:23.826684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:02:23.826700 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:02:23.826759 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:02:23.827170 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.827933 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.829180 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.829770 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.829835 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.829845 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:02:23.830293 (+ 448us) server_negotiation.cc:299] Negotiation successful
0811 01:02:23.830343 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195}
I20260811 01:02:23.830715 486 raft_consensus.cc:2454] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c48a766644b4d9294999e2051e8adfd in term 1.
I20260811 01:02:23.830678 32698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507e4acc443b457a87dfd6519d394afb" candidate_uuid: "3c48a766644b4d9294999e2051e8adfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f64573dc05c441f0bc87a4048dce548c" is_pre_election: true
I20260811 01:02:23.830844 32698 raft_consensus.cc:2454] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c48a766644b4d9294999e2051e8adfd in term 0.
I20260811 01:02:23.830977 32696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507e4acc443b457a87dfd6519d394afb" candidate_uuid: "3c48a766644b4d9294999e2051e8adfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f64573dc05c441f0bc87a4048dce548c"
I20260811 01:02:23.831054 32696 raft_consensus.cc:3037] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:02:23.831358 612 leader_election.cc:302] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c48a766644b4d9294999e2051e8adfd, d20a97071f3e499d9c06e694d8592465; no voters:
I20260811 01:02:23.831542 848 raft_consensus.cc:2781] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:02:23.831776 848 raft_consensus.cc:686] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [term 1 LEADER]: Becoming Leader. State: Replica: 3c48a766644b4d9294999e2051e8adfd, State: Running, Role: LEADER
I20260811 01:02:23.831873 848 consensus_queue.cc:237] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20a97071f3e499d9c06e694d8592465" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 45787 } } peers { permanent_uuid: "3c48a766644b4d9294999e2051e8adfd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 44049 } } peers { permanent_uuid: "f64573dc05c441f0bc87a4048dce548c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44025 } }
I20260811 01:02:23.831990 32696 raft_consensus.cc:2454] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c48a766644b4d9294999e2051e8adfd in term 1.
I20260811 01:02:23.833091 32432 catalog_manager.cc:5495] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c48a766644b4d9294999e2051e8adfd (127.13.30.131). New cstate: current_term: 1 leader_uuid: "3c48a766644b4d9294999e2051e8adfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d20a97071f3e499d9c06e694d8592465" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 45787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c48a766644b4d9294999e2051e8adfd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 44049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f64573dc05c441f0bc87a4048dce548c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44025 } health_report { overall_health: UNKNOWN } } }
W20260811 01:02:23.859864 570 tablet.cc:2369] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:02:23.861509 827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.857514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52586 (local address 127.13.30.131:44049)
0811 01:02:23.857560 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 01:02:23.857563 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:02:23.857574 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:02:23.857621 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:02:23.857621 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:02:23.857644 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:02:23.857714 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:02:23.857908 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.858624 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.860264 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:02:23.860586 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:02:23.860653 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:02:23.860870 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:02:23.861025 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:02:23.861094 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 01:02:23.861347 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 01:02:23.861374 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 01:02:23.864193 32696 raft_consensus.cc:1261] T 507e4acc443b457a87dfd6519d394afb P f64573dc05c441f0bc87a4048dce548c [term 1 FOLLOWER]: Refusing update from remote peer 3c48a766644b4d9294999e2051e8adfd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:02:23.864754 851 consensus_queue.cc:1035] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f64573dc05c441f0bc87a4048dce548c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:02:23.867950 486 raft_consensus.cc:1261] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465 [term 1 FOLLOWER]: Refusing update from remote peer 3c48a766644b4d9294999e2051e8adfd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:02:23.868361 851 consensus_queue.cc:1035] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d20a97071f3e499d9c06e694d8592465" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 45787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:02:23.873420 854 mvcc.cc:205] Tried to move back new op lower bound from 7317135949264424960 to 7317135949136035840. Current Snapshot: MvccSnapshot[applied={T|T < 7317135949264424960}]
I20260811 01:02:23.873749 860 mvcc.cc:205] Tried to move back new op lower bound from 7317135949264424960 to 7317135949136035840. Current Snapshot: MvccSnapshot[applied={T|T < 7317135949264424960}]
I20260811 01:02:23.876639 855 mvcc.cc:205] Tried to move back new op lower bound from 7317135949264424960 to 7317135949136035840. Current Snapshot: MvccSnapshot[applied={T|T < 7317135949264424960}]
I20260811 01:02:23.880131 32432 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:02:23.880249 32432 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:02:23.881181 32432 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a99228caf52849868c23f9473bb72c2c: Sending DeleteTablet for 3 replicas of tablet 507e4acc443b457a87dfd6519d394afb
I20260811 01:02:23.881747 410 tablet_service.cc:1514] Processing DeleteTablet for tablet 507e4acc443b457a87dfd6519d394afb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:02:23 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:38122
I20260811 01:02:23.882058 32658 tablet_service.cc:1514] Processing DeleteTablet for tablet 507e4acc443b457a87dfd6519d394afb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:02:23 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:43168
I20260811 01:02:23.882671 689 tablet_service.cc:1514] Processing DeleteTablet for tablet 507e4acc443b457a87dfd6519d394afb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:02:23 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:52572
I20260811 01:02:23.883435 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 32561
I20260811 01:02:23.896862 866 tablet_replica.cc:330] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465: stopping tablet replica
I20260811 01:02:23.897120 869 tablet_replica.cc:330] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd: stopping tablet replica
I20260811 01:02:23.897375 869 raft_consensus.cc:2229] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:02:23.897593 866 raft_consensus.cc:2229] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:02:23.897827 869 raft_consensus.cc:2258] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:02:23.898011 866 raft_consensus.cc:2258] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:02:23.898775 866 ts_tablet_manager.cc:1905] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:02:23.899233 869 ts_tablet_manager.cc:1905] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:02:23.902839 866 ts_tablet_manager.cc:1918] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:02:23.909212 866 log.cc:1196] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/507e4acc443b457a87dfd6519d394afb
I20260811 01:02:23.909924 866 ts_tablet_manager.cc:1939] T 507e4acc443b457a87dfd6519d394afb P d20a97071f3e499d9c06e694d8592465: Deleting consensus metadata
I20260811 01:02:23.909583 869 ts_tablet_manager.cc:1918] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:02:23.910261 869 log.cc:1196] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/507e4acc443b457a87dfd6519d394afb
I20260811 01:02:23.910858 869 ts_tablet_manager.cc:1939] T 507e4acc443b457a87dfd6519d394afb P 3c48a766644b4d9294999e2051e8adfd: Deleting consensus metadata
I20260811 01:02:23.911470 32405 catalog_manager.cc:4841] TS d20a97071f3e499d9c06e694d8592465 (127.13.30.130:45787): tablet 507e4acc443b457a87dfd6519d394afb (table test-table [id=4bebafb76ad548c9ab628ec7ec4f5dec]) successfully deleted
I20260811 01:02:23.918111 32401 catalog_manager.cc:4841] TS 3c48a766644b4d9294999e2051e8adfd (127.13.30.131:44049): tablet 507e4acc443b457a87dfd6519d394afb (table test-table [id=4bebafb76ad548c9ab628ec7ec4f5dec]) successfully deleted
W20260811 01:02:23.918658 32405 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:44025 (error 108)
I20260811 01:02:23.920660 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 331
I20260811 01:02:23.986615 826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:23.986323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:44025 (local address 127.0.0.1:43180)
0811 01:02:23.986500 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 01:02:23.986564 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:44025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144}
W20260811 01:02:23.988065 32405 catalog_manager.cc:4584] TS f64573dc05c441f0bc87a4048dce548c (127.13.30.129:44025): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 507e4acc443b457a87dfd6519d394afb: Network error: Client connection negotiation failed: client connection to 127.13.30.129:44025: connect: Connection refused (error 111)
I20260811 01:02:24.004822 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 578
I20260811 01:02:24.041747 826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:24.041585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:44025 (local address 127.0.0.1:43196)
0811 01:02:24.041655 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 01:02:24.041693 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:44025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 01:02:24.042280 826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:02:24.042188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:44025 (local address 127.0.0.1:43210)
0811 01:02:24.042224 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 01:02:24.042251 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:44025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 01:02:24.069068 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 32372
I20260811 01:02:24.092986 13434 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 01:02:24.439478 13434 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 01:02:24.439597 13434 mini_ranger.cc:66] Stopping Ranger...
I20260811 01:02:24.794610 13434 mini_ranger.cc:68] Stopped Ranger
2026-08-11 01:02:24.794 UTC [31701] LOG: received smart shutdown request
2026-08-11 01:02:24.799 UTC [31701] LOG: background worker "logical replication launcher" (PID 31712) exited with exit code 1
2026-08-11 01:02:24.799 UTC [31706] LOG: shutting down
2026-08-11 01:02:24.955 UTC [31701] LOG: database system is shut down
2026-08-11T01:02:24Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53304 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:02:25 dist-test-slave-42z9 krb5kdc[882](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:02:25 dist-test-slave-42z9 krb5kdc[882](info): set up 2 sockets
Aug 11 01:02:25 dist-test-slave-42z9 krb5kdc[882](info): commencing operation
krb5kdc: starting...
W20260811 01:02:26.227084 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:02:26 dist-test-slave-42z9 krb5kdc[882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410146, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:02:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:02:26Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.13.30.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.13.30.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/rangeradmin_127.13.30.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/rangeradmin_127.13.30.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.13.30.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.13.30.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/rangerlookup_127.13.30.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/rangerlookup_127.13.30.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.30.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.13.30.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/HTTP_127.13.30.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/HTTP_127.13.30.148@KRBTEST.COM.keytab.
I20260811 01:02:26.410354 13434 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task0Qaj6g/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/postgres -l logfile start
2026-08-11 01:02:28.997 UTC [940] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 01:02:28.997 UTC [940] LOG: listening on IPv4 address "127.13.30.148", port 43911
2026-08-11 01:02:29.001 UTC [940] LOG: listening on Unix socket "/tmp/.s.PGSQL.43911"
2026-08-11 01:02:29.031 UTC [945] LOG: database system was shut down at 2026-08-11 01:02:27 UTC
2026-08-11 01:02:29.035 UTC [940] LOG: database system is ready to accept connections
I20260811 01:02:30.121765 13434 mini_postgres.cc:96] Postgres bound to 43911
2026-08-11 01:02:30.129 UTC [957] FATAL: database "slave" does not exist
127.13.30.148:43911 - accepting connections
I20260811 01:02:30.129799 13434 mini_ranger.cc:161] Starting Ranger...
I20260811 01:02:30.146548 13434 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 01:02:30.647982 13434 mini_ranger.cc:87] Created ranger Postgres database
I20260811 01:02:30.648062 13434 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-admin
2026-08-11 01:02:30,936 [I] DB FLAVOR :POSTGRES
2026-08-11 01:02:30,937 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 01:02:30,937 [I] Checking connection..
2026-08-11 01:02:30,937 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 01:02:31,200 [I] Checking connection passed.
2026-08-11 01:02:31,200 [I] --------- Verifying version history table ---------
2026-08-11 01:02:31,200 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:02:31,485 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 01:02:31,485 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:02:31,745 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 01:02:31,745 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 01:02:31,746 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 01:02:32.002 UTC [1065] WARNING: there is no transaction in progress
2026-08-11 01:02:32,013 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 01:02:32,013 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:02:32,285 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 01:02:32,286 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 01:02:32,286 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 01:02:32,565 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 01:02:32,843 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-42z9.c.gcp-upstream.internal','N') ;"
2026-08-11 01:02:33,110 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 01:02:33,367 [I] Table x_portal_user does not exist in database ranger
2026-08-11 01:02:33,368 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 01:02:33,648 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 01:02:33,648 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 01:02:33,899 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 01:02:34,184 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 01:02:34,184 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 01:02:35.272 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.290 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.308 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.325 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.344 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.363 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.424 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.432 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.451 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.464 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.475 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.491 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.502 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.510 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.517 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:35.525 UTC [1245] WARNING: there is no transaction in progress
2026-08-11 01:02:36,237 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 01:02:36,238 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 01:02:36,490 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 01:02:36,491 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 01:02:36,761 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 01:02:36,761 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 01:02:37,048 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 01:02:37,049 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 01:02:37,321 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 01:02:37,595 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-42z9.c.gcp-upstream.internal';"
2026-08-11 01:02:37,849 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 01:02:37,849 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 01:02:38,128 [I] DB_PATCHES have already been applied
I20260811 01:02:38.136655 13434 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-admin:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task0Qaj6g/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 01:02:38.136729 13434 mini_ranger.cc:193] Using host: 127.13.30.148
I20260811 01:02:38.141238 13434 mini_ranger.cc:227] Ranger admin URL: http://127.13.30.148:34869
Aug 11, 2026 1:02:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 1:02:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 1:02:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 1:02:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 1:02:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 1:02:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 1:02:39 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 01:02:39.412115 13434 mini_ranger.cc:160] Time spent starting Ranger: real 9.282s user 0.000s sys 0.011s
Aug 11, 2026 1:03:01 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 1:03:01 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 1:03:01 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 1:03:01 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 1:03:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 1:03:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 1:03:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 1:03:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 1:03:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 1:03:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 1:03:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 1:03:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 1:03:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 1:03:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 1:03:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 1:03:01 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 1:03:01 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 1:03:02 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 01:03:02.979225 13434 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.13.30.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.13.30.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/rangerkms_127.13.30.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.13.30.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/rangerkms_127.13.30.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.30.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.13.30.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.30.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/HTTP_127.13.30.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.30.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/HTTP_127.13.30.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 01:03:03 dist-test-slave-42z9 krb5kdc[882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410183, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 01:03:03.088867 13434 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 01:03:03.100577 13434 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 01:03:04.012286 13434 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 01:03:04.012424 13434 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-kms
I20260811 01:03:04.012440 13434 mini_ranger_kms.cc:227] Using postgres at 127.13.30.148:43911
2026-08-11 01:03:04,245 [I] DB FLAVOR :POSTGRES
2026-08-11 01:03:04,245 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 01:03:04,245 [I] Checking connection
2026-08-11 01:03:04,246 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 01:03:04,507 [I] connection success
2026-08-11 01:03:04,507 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 01:03:04,507 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 01:03:04,507 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 01:03:04,782 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 01:03:04,782 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 01:03:04,782 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 01:03:04,782 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.30.148:43911/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 01:03:05,093 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 01:03:05.611939 13434 mini_ranger_kms.cc:310] Created kms service
I20260811 01:03:05.846889 13434 mini_ranger_kms.cc:326] Created kudu user
I20260811 01:03:05.897810 13434 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 01:03:05 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410183, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:03:06.332559 13434 mini_ranger_kms.cc:384] Added ranger policy
I20260811 01:03:06.332695 13434 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-kms:/tmp/dist-test-task0Qaj6g/build/release/bin/postgresql.jar:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task0Qaj6g/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 01:03:06.332712 13434 mini_ranger_kms.cc:240] Using host: 127.13.30.148
I20260811 01:03:06.338153 13434 mini_ranger_kms.cc:276] Ranger KMS PID: 1552
I20260811 01:03:06.338300 13434 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.13.30.148:43077
Aug 11, 2026 1:03:07 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 1:03:07 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 1:03:07 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 1:03:07 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 1:03:07 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 1:03:07 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 01:03:08 dist-test-slave-42z9 krb5kdc[882](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786410188, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.30.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:08.899174 13434 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.810s user 0.000s sys 0.213s
I20260811 01:03:08.899302 13434 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 01:03:08.899348 13434 mini_ranger_kms.cc:401] 127.13.30.148:43077/kms/v1/keys
Aug 11 01:03:09 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410188, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.30.148@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
Aug 11 01:03:09 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410188, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.30.148@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
Aug 11 01:03:12 dist-test-slave-42z9 krb5kdc[882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:03:12.244915 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:44481
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:36197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:44481
--ranger_config_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.30.148:43077/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:12.334275 1633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:12.334548 1633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:12.334585 1633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:12.335904 1633 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:03:12.335959 1633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:12.335980 1633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:12.335995 1633 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:03:12.336014 1633 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:03:12.337918 1633 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/wal
--ranger_kms_url=127.13.30.148:43077/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:44481
--ranger_config_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:44481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:12.338215 1633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:12.338460 1633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:12.344120 1640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:12.344130 1641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:12.344224 1648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:12.344112 1633 server_base.cc:1034] running on GCE node
I20260811 01:03:12.344631 1633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:12.344974 1633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:12.346139 1633 hybrid_clock.cc:648] HybridClock initialized: now 1786410192346122 us; error 36 us; skew 500 ppm
Aug 11 01:03:12 dist-test-slave-42z9 krb5kdc[882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410192, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:12.348990 1633 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:03:12.349594 1633 webserver.cc:460] Webserver started at http://127.13.30.190:42409/ using document root <none> and password file <none>
I20260811 01:03:12.349821 1633 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:12.349865 1633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:12.350016 1633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:03:12 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410192, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:03:12.403057 1633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "6afe55337e694553b00dbc984ff7111c"
format_stamp: "Formatted at 2026-08-11 01:03:12 on dist-test-slave-42z9"
server_key: "87ffa7f04419ac4a7c238d30df6a187d"
server_key_iv: "124f09428e7016c77ff87abaf75f2afa"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:12.403477 1633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "6afe55337e694553b00dbc984ff7111c"
format_stamp: "Formatted at 2026-08-11 01:03:12 on dist-test-slave-42z9"
server_key: "87ffa7f04419ac4a7c238d30df6a187d"
server_key_iv: "124f09428e7016c77ff87abaf75f2afa"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:12.405066 1633 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:03:12.418473 1659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:12.418798 1633 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:03:12.418941 1633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "6afe55337e694553b00dbc984ff7111c"
format_stamp: "Formatted at 2026-08-11 01:03:12 on dist-test-slave-42z9"
server_key: "87ffa7f04419ac4a7c238d30df6a187d"
server_key_iv: "124f09428e7016c77ff87abaf75f2afa"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:12.419060 1633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:12.439106 1633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:12.441169 1633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:12.441318 1633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:12.446332 1633 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:44481
I20260811 01:03:12.446399 1742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:44481 every 8 connection(s)
I20260811 01:03:12.446805 1633 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:03:12.447566 1744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:12.450095 1744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c: Bootstrap starting.
I20260811 01:03:12.450816 1744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:12.451130 1744 log.cc:824] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:12.451938 1744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c: No bootstrap required, opened a new log
I20260811 01:03:12.452791 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 1633
I20260811 01:03:12.452900 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:03:12.453114 13434 external_mini_cluster.cc:1428] Setting key add58dda6e3386605609a71af5403257
I20260811 01:03:12.454490 1744 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afe55337e694553b00dbc984ff7111c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 44481 } }
I20260811 01:03:12.454643 1744 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:12.454677 1744 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afe55337e694553b00dbc984ff7111c, State: Initialized, Role: FOLLOWER
I20260811 01:03:12.454855 1744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afe55337e694553b00dbc984ff7111c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 44481 } }
I20260811 01:03:12.454963 1744 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:03:12.454998 1744 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:03:12.455070 1744 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:12.455914 1744 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afe55337e694553b00dbc984ff7111c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 44481 } }
I20260811 01:03:12.456038 1744 leader_election.cc:302] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6afe55337e694553b00dbc984ff7111c; no voters:
I20260811 01:03:12.456234 1744 leader_election.cc:288] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:03:12.456284 1751 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:03:12.456529 1751 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 1 LEADER]: Becoming Leader. State: Replica: 6afe55337e694553b00dbc984ff7111c, State: Running, Role: LEADER
I20260811 01:03:12.456621 1744 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:03:12.456679 1751 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afe55337e694553b00dbc984ff7111c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 44481 } }
I20260811 01:03:12.457093 1751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6afe55337e694553b00dbc984ff7111c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afe55337e694553b00dbc984ff7111c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 44481 } } }
I20260811 01:03:12.457261 1751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:12.457480 1751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6afe55337e694553b00dbc984ff7111c. Latest consensus state: current_term: 1 leader_uuid: "6afe55337e694553b00dbc984ff7111c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afe55337e694553b00dbc984ff7111c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 44481 } } }
I20260811 01:03:12.457600 1751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:12.457768 1762 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:03:12.458178 1744 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 01:03:12.458369 1762 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 01:03:12 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:12.470674 1762 catalog_manager.cc:1347] Generated new cluster ID: a9654b7e75c0450b86acf695d56b4f6f
I20260811 01:03:12.470752 1762 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:03:12.471012 1749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:12.453716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52686 (local address 127.13.30.190:44481)
0811 01:03:12.453928 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:12.453938 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:12.453974 (+ 36us) server_negotiation.cc:407] Connection header received
0811 01:03:12.454471 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:12.454481 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:12.454550 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:12.454704 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:12.455672 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:12.457214 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:12.458444 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:12.463107 (+ 4663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:12.463267 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:12.466521 (+ 3254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:12.466526 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:12.466527 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:12.466541 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:12.468611 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:12.469056 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:12.469059 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:12.469060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:12.469191 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:12.469394 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:12.469395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:12.469395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:12.469768 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:12.470387 (+ 619us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:12.470479 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 01:03:12.470632 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":88,"threads_started":1}
I20260811 01:03:12.485181 1762 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:03:12.486044 1762 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:03:12.495173 1762 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c: Generated new TSK 0
I20260811 01:03:12.495493 1762 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:03:13.312284 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.30.148:43077/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:44481
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:36197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:13.449658 1819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:13.449970 1819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:13.450016 1819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:13.452374 1819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:13.452473 1819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:13.452521 1819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:03:13.455456 1819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.13.30.148:43077/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:44481
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:13.455806 1819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:13.456182 1819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:13.463502 1834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:13.463517 1831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:13.464604 1819 server_base.cc:1034] running on GCE node
W20260811 01:03:13.465618 1830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:13.465943 1819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:13.466284 1819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:13.467479 1819 hybrid_clock.cc:648] HybridClock initialized: now 1786410193467451 us; error 43 us; skew 500 ppm
Aug 11 01:03:13 dist-test-slave-42z9 krb5kdc[882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410193, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:13.471143 1819 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:03:13.471764 1819 webserver.cc:460] Webserver started at http://127.13.30.129:38849/ using document root <none> and password file <none>
I20260811 01:03:13.472033 1819 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:13.472098 1819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:13.472306 1819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:03:13 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410193, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:03:13.488862 1819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "19efe236ae5c404f80d1f6d4757f977c"
format_stamp: "Formatted at 2026-08-11 01:03:13 on dist-test-slave-42z9"
server_key: "53b64bae63e48a539175d9ebd63db971"
server_key_iv: "b64341e58b7faabc2fab5a24a92f37fb"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:13.489274 1819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "19efe236ae5c404f80d1f6d4757f977c"
format_stamp: "Formatted at 2026-08-11 01:03:13 on dist-test-slave-42z9"
server_key: "53b64bae63e48a539175d9ebd63db971"
server_key_iv: "b64341e58b7faabc2fab5a24a92f37fb"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:13.491158 1819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:03:13.505568 1848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:13.505796 1819 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:03:13.505897 1819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "19efe236ae5c404f80d1f6d4757f977c"
format_stamp: "Formatted at 2026-08-11 01:03:13 on dist-test-slave-42z9"
server_key: "53b64bae63e48a539175d9ebd63db971"
server_key_iv: "b64341e58b7faabc2fab5a24a92f37fb"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:13.506001 1819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:13.536334 1819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:13.540087 1819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:13.540359 1819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:13.540735 1819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:13.541224 1819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:13.541345 1819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:13.541494 1819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:13.541577 1819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:13.549002 1819 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:34759
I20260811 01:03:13.549122 2042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:34759 every 8 connection(s)
I20260811 01:03:13.549702 1819 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:03:13.555063 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 1819
I20260811 01:03:13.555173 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:03:13.555357 13434 external_mini_cluster.cc:1428] Setting key 799c618449cea079bb5ff3c1fc17935b
Aug 11 01:03:13 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410193, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
I20260811 01:03:13.571316 2049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:13.550559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:60285 (local address 127.13.30.190:44481)
0811 01:03:13.550740 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:13.550742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:13.550971 (+ 229us) server_negotiation.cc:407] Connection header received
0811 01:03:13.551608 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:13.551610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:13.551625 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:13.551663 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:13.552535 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:13.553318 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:13.554789 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:13.555108 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:13.555148 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:13.565986 (+ 10838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:13.565989 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:13.565989 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:13.565998 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:13.567559 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:13.568106 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:13.568108 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:13.568108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:13.568187 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:13.568568 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:13.568570 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:13.568570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:13.568735 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:13.568775 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:13.571062 (+ 2287us) server_negotiation.cc:299] Negotiation successful
0811 01:03:13.571187 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":62,"threads_started":1}
I20260811 01:03:13.572212 2053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:13.550543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:44481 (local address 127.13.30.129:60285)
0811 01:03:13.550810 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:13.550858 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:13.551471 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:13.551848 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:13.551852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:13.552119 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:13.552398 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:13.552405 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:13.553434 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:13.553462 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:13.554684 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:13.554687 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:13.555352 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:13.555353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:13.555561 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:13.556767 (+ 1206us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:13.556778 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:13.565824 (+ 9046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:13.567696 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:13.567710 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:13.567713 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:13.567982 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:13.568270 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:13.568271 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:13.568271 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:13.568491 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:13.570644 (+ 2153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:13.570655 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:13.570883 (+ 228us) client_negotiation.cc:769] Sending connection context
0811 01:03:13.571708 (+ 825us) client_negotiation.cc:240] Negotiation successful
0811 01:03:13.571942 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":95,"threads_started":1}
I20260811 01:03:13.572966 2046 heartbeater.cc:347] Connected to a master server at 127.13.30.190:44481
I20260811 01:03:13.573071 2046 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:13.573278 2046 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
I20260811 01:03:13.573922 1687 ts_manager.cc:194] Registered new tserver with Master: 19efe236ae5c404f80d1f6d4757f977c (127.13.30.129:34759)
I20260811 01:03:13.574743 1687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:60285
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:03:13.590962 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.30.148:43077/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:44481
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:36197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:13.726145 2056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:13.726526 2056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:13.726624 2056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:13.728683 2056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:13.728853 2056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:13.728951 2056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:03:13.731607 2056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.13.30.148:43077/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:44481
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:13.732209 2056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:13.732590 2056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:13.758836 2073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:13.758854 2075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:13.759737 2072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:13.759881 2056 server_base.cc:1034] running on GCE node
I20260811 01:03:13.760226 2056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:13.760607 2056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:13.776142 2056 hybrid_clock.cc:648] HybridClock initialized: now 1786410193776096 us; error 62 us; skew 500 ppm
Aug 11 01:03:13 dist-test-slave-42z9 krb5kdc[882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410193, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:13.783484 2056 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:03:13.784276 2056 webserver.cc:460] Webserver started at http://127.13.30.130:33401/ using document root <none> and password file <none>
I20260811 01:03:13.784615 2056 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:13.784700 2056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:13.784868 2056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:03:13 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410193, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:03:13.805135 2056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "e72da32aac9e43148600da4d92bc8729"
format_stamp: "Formatted at 2026-08-11 01:03:13 on dist-test-slave-42z9"
server_key: "ed307caa8e48cd717cfdb06c5f50df09"
server_key_iv: "aae4747199aab744f786e8e8727e3e79"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:13.805792 2056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "e72da32aac9e43148600da4d92bc8729"
format_stamp: "Formatted at 2026-08-11 01:03:13 on dist-test-slave-42z9"
server_key: "ed307caa8e48cd717cfdb06c5f50df09"
server_key_iv: "aae4747199aab744f786e8e8727e3e79"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:13.808270 2056 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
Aug 11 01:03:13 dist-test-slave-42z9 krb5kdc[882](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786410193, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:13.828104 2090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:13.828316 2056 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:03:13.828446 2056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "e72da32aac9e43148600da4d92bc8729"
format_stamp: "Formatted at 2026-08-11 01:03:13 on dist-test-slave-42z9"
server_key: "ed307caa8e48cd717cfdb06c5f50df09"
server_key_iv: "aae4747199aab744f786e8e8727e3e79"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:13.828557 2056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:13.849284 2056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:13.852069 2056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:13.852326 2056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:13.852674 2056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:13.853148 2056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:13.853247 2056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:13.853329 2056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:13.853392 2056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:13.860273 2056 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:46541
I20260811 01:03:13.860843 2056 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:03:13.861673 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 2056
I20260811 01:03:13.861783 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:03:13.861986 13434 external_mini_cluster.cc:1428] Setting key c71a5680a462e75b56d79a46757af523
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
I20260811 01:03:13.873936 2259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:46541 every 8 connection(s)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Aug 11 01:03:13 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410193, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:13.890786 2264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:13.874714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:44481 (local address 127.13.30.130:53759)
0811 01:03:13.879129 (+ 4415us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:13.879222 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:13.880021 (+ 799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:13.880464 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:13.880469 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:13.880748 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:13.881060 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:13.881067 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:13.882180 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:13.882181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:13.883568 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:13.883573 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:13.884209 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:13.884211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:13.884388 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:13.885085 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:13.885098 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:13.886993 (+ 1895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:13.888966 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:13.888978 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:13.888981 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:13.889331 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:13.889597 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:13.889598 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:13.889598 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:13.889748 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:13.890056 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:13.890064 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:13.890243 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 01:03:13.890348 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 01:03:13.890528 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4339,"thread_start_us":101,"threads_started":1}
I20260811 01:03:13.891220 2049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:13.874726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:53759 (local address 127.13.30.190:44481)
0811 01:03:13.874783 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:13.874785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:13.879376 (+ 4591us) server_negotiation.cc:407] Connection header received
0811 01:03:13.880190 (+ 814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:13.880192 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:13.880214 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:13.880245 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:13.881183 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:13.882065 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:13.883681 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:13.884039 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:13.884104 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:13.887135 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:13.887137 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:13.887137 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:13.887146 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:13.888848 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:13.889430 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:13.889431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:13.889432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:13.889530 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:13.889811 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:13.889811 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:13.889812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:13.889974 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:13.890031 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:13.891026 (+ 995us) server_negotiation.cc:299] Negotiation successful
0811 01:03:13.891131 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 01:03:13.891863 2261 heartbeater.cc:347] Connected to a master server at 127.13.30.190:44481
I20260811 01:03:13.891978 2261 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:13.892189 2261 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
I20260811 01:03:13.892606 1687 ts_manager.cc:194] Registered new tserver with Master: e72da32aac9e43148600da4d92bc8729 (127.13.30.130:46541)
I20260811 01:03:13.893090 1687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:53759
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:03:13.902711 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.30.148:43077/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:44481
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:36197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:14.038131 2266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:14.038552 2266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:14.038661 2266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:14.040771 2266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:14.041069 2266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:14.041190 2266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:03:14.043797 2266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.13.30.148:43077/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:44481
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:14.044405 2266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:14.044795 2266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:14.052502 2278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:14.052948 2280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:14.053227 2277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:14.054399 2266 server_base.cc:1034] running on GCE node
I20260811 01:03:14.054661 2266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:14.054999 2266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:14.056162 2266 hybrid_clock.cc:648] HybridClock initialized: now 1786410194056136 us; error 41 us; skew 500 ppm
Aug 11 01:03:14 dist-test-slave-42z9 krb5kdc[882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410194, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:14.059908 2266 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:03:14.060518 2266 webserver.cc:460] Webserver started at http://127.13.30.131:36017/ using document root <none> and password file <none>
I20260811 01:03:14.060789 2266 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:14.060851 2266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:14.061014 2266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:03:14 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410194, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:03:14.083159 2266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "4b62cf8f456d4ca2849392b7b6d07b59"
format_stamp: "Formatted at 2026-08-11 01:03:14 on dist-test-slave-42z9"
server_key: "71e3ada116c5ab3355648bd412c352bd"
server_key_iv: "4a2789f096c18083475992c37cfc66ad"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:14.083798 2266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "4b62cf8f456d4ca2849392b7b6d07b59"
format_stamp: "Formatted at 2026-08-11 01:03:14 on dist-test-slave-42z9"
server_key: "71e3ada116c5ab3355648bd412c352bd"
server_key_iv: "4a2789f096c18083475992c37cfc66ad"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:14.095557 2266 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.000s sys 0.002s
I20260811 01:03:14.116050 2292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:14.116364 2266 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 01:03:14.116494 2266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "4b62cf8f456d4ca2849392b7b6d07b59"
format_stamp: "Formatted at 2026-08-11 01:03:14 on dist-test-slave-42z9"
server_key: "71e3ada116c5ab3355648bd412c352bd"
server_key_iv: "4a2789f096c18083475992c37cfc66ad"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:14.116604 2266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:14.134199 2266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:14.136919 2266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:14.137167 2266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:14.137609 2266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:14.138114 2266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:14.138221 2266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:14.138306 2266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:14.138376 2266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:14.150321 2266 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:43057
I20260811 01:03:14.151655 2266 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:03:14.151940 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 2266
I20260811 01:03:14.152043 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:03:14.152236 13434 external_mini_cluster.cc:1428] Setting key 5bc9878b3cef81197f4ea1fe38e97897
I20260811 01:03:14.153122 2472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:43057 every 8 connection(s)
Aug 11 01:03:14 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410194, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:14.165313 2049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:14.153556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:37435 (local address 127.13.30.190:44481)
0811 01:03:14.153606 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:14.153608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:14.153911 (+ 303us) server_negotiation.cc:407] Connection header received
0811 01:03:14.154639 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:14.154641 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:14.154655 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:14.154685 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:14.155552 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:14.156356 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:14.158207 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:14.158545 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:14.158588 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:14.161636 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:14.161638 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:14.161638 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:14.161649 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:14.163475 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:14.164071 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:14.164073 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:14.164073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:14.164143 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:14.164459 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:14.164461 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:14.164461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:14.164617 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:14.164664 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:14.165101 (+ 437us) server_negotiation.cc:299] Negotiation successful
0811 01:03:14.165207 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 01:03:14.165560 2476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:14.153309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:44481 (local address 127.13.30.131:37435)
0811 01:03:14.153773 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:14.153825 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:14.154505 (+ 680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:14.154872 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:14.154876 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:14.155145 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:14.155437 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:14.155444 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:14.156580 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:14.156581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:14.158099 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:14.158104 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:14.158700 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:14.158701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:14.158850 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:14.159605 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:14.159618 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:14.161291 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:14.163591 (+ 2300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:14.163601 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:14.163604 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:14.163966 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:14.164221 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:14.164222 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:14.164222 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:14.164375 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:14.164715 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:14.164723 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:14.164936 (+ 213us) client_negotiation.cc:769] Sending connection context
0811 01:03:14.165066 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 01:03:14.165251 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":430,"threads_started":1}
I20260811 01:03:14.166218 2474 heartbeater.cc:347] Connected to a master server at 127.13.30.190:44481
I20260811 01:03:14.166344 2474 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:14.166570 2474 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
I20260811 01:03:14.167092 1687 ts_manager.cc:194] Registered new tserver with Master: 4b62cf8f456d4ca2849392b7b6d07b59 (127.13.30.131:43057)
I20260811 01:03:14.167613 1687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:37435
I20260811 01:03:14.171015 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:03:14.171908 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 1819
I20260811 01:03:14.302995 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 2056
I20260811 01:03:14.358268 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 2266
I20260811 01:03:14.375125 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 1633
I20260811 01:03:14.392910 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:44481
--webserver_interface=127.13.30.190
--webserver_port=42409
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:36197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:44481
--ranger_config_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.30.148:43077/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.30.148:43077/kms with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:14.479782 2478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:14.480023 2478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:14.480057 2478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:14.481524 2478 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:03:14.481585 2478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:14.481606 2478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:14.481621 2478 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:03:14.481638 2478 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:03:14.483428 2478 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.30.148:43077/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:44481
--ranger_config_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:44481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=42409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:14.483696 2478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:14.483920 2478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:14.488961 2486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:14.488956 2487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:14.489271 2478 server_base.cc:1034] running on GCE node
W20260811 01:03:14.489037 2491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:14.489583 2478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:14.489904 2478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:14.491072 2478 hybrid_clock.cc:648] HybridClock initialized: now 1786410194491061 us; error 26 us; skew 500 ppm
Aug 11 01:03:14 dist-test-slave-42z9 krb5kdc[882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410194, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:14.493633 2478 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:03:14.494143 2478 webserver.cc:460] Webserver started at http://127.13.30.190:42409/ using document root <none> and password file <none>
I20260811 01:03:14.494360 2478 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:14.494417 2478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 01:03:14 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410194, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:03:14.564623 2478 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:03:14.565361 2500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:14.565536 2478 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:03:14.565639 2478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "6afe55337e694553b00dbc984ff7111c"
format_stamp: "Formatted at 2026-08-11 01:03:12 on dist-test-slave-42z9"
server_key: "87ffa7f04419ac4a7c238d30df6a187d"
server_key_iv: "124f09428e7016c77ff87abaf75f2afa"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:14.566044 2478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:14.574800 2478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:14.576651 2478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:14.576788 2478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:14.581591 2478 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:44481
I20260811 01:03:14.581660 2584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:44481 every 8 connection(s)
I20260811 01:03:14.582060 2478 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:03:14.583444 2587 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:03:14.584196 2587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c: Bootstrap starting.
I20260811 01:03:14.591113 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 2478
I20260811 01:03:14.591527 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.30.148:43077/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:34759
--local_ip_for_outbound_sockets=127.13.30.129
--tserver_master_addrs=127.13.30.190:44481
--webserver_port=38849
--webserver_interface=127.13.30.129
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:36197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.30.148:43077/kms with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:03:14.593288 2587 log.cc:824] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:14.595191 2587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:03:14.595512 2587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c: Bootstrap complete.
I20260811 01:03:14.599243 2587 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afe55337e694553b00dbc984ff7111c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 44481 } }
I20260811 01:03:14.599656 2587 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afe55337e694553b00dbc984ff7111c, State: Initialized, Role: FOLLOWER
I20260811 01:03:14.599848 2587 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afe55337e694553b00dbc984ff7111c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 44481 } }
I20260811 01:03:14.600083 2587 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:03:14.600160 2587 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:03:14.600209 2587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:03:14.601845 2587 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afe55337e694553b00dbc984ff7111c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 44481 } }
I20260811 01:03:14.601992 2587 leader_election.cc:302] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6afe55337e694553b00dbc984ff7111c; no voters:
I20260811 01:03:14.602257 2587 leader_election.cc:288] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 01:03:14.602335 2595 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:03:14.602556 2595 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [term 2 LEADER]: Becoming Leader. State: Replica: 6afe55337e694553b00dbc984ff7111c, State: Running, Role: LEADER
I20260811 01:03:14.602710 2587 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:03:14.602700 2595 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afe55337e694553b00dbc984ff7111c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 44481 } }
I20260811 01:03:14.603200 2595 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6afe55337e694553b00dbc984ff7111c. Latest consensus state: current_term: 2 leader_uuid: "6afe55337e694553b00dbc984ff7111c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afe55337e694553b00dbc984ff7111c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 44481 } } }
I20260811 01:03:14.603363 2595 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:14.603310 2596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6afe55337e694553b00dbc984ff7111c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afe55337e694553b00dbc984ff7111c" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 44481 } } }
I20260811 01:03:14.603559 2596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:14.603688 2606 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:03:14.604291 2606 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:03:14.604503 2606 catalog_manager.cc:1259] Loaded cluster ID: a9654b7e75c0450b86acf695d56b4f6f
I20260811 01:03:14.604583 2606 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:03:14.604713 2587 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 01:03:14.605921 2606 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:03:14.606165 2606 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c: Loaded TSK: 0
I20260811 01:03:14.606460 2606 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:03:14.714653 2592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:14.714993 2592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:14.715042 2592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:14.717020 2592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:14.717108 2592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:14.717154 2592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:03:14.719779 2592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.30.148:43077/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:34759
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=38849
--tserver_master_addrs=127.13.30.190:44481
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:14.720258 2592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:14.720598 2592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:14.727380 2654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:14.727556 2650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:14.727382 2651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:14.729162 2592 server_base.cc:1034] running on GCE node
I20260811 01:03:14.729413 2592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:14.729769 2592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:14.732760 2592 hybrid_clock.cc:648] HybridClock initialized: now 1786410194732736 us; error 32 us; skew 500 ppm
Aug 11 01:03:14 dist-test-slave-42z9 krb5kdc[882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410194, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:14.736521 2592 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:03:14.737198 2592 webserver.cc:460] Webserver started at http://127.13.30.129:38849/ using document root <none> and password file <none>
I20260811 01:03:14.737556 2592 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:14.737743 2592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 01:03:14 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410194, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:03:14.769918 2592 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260811 01:03:14.770787 2663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:14.771023 2592 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 01:03:14.771118 2592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "19efe236ae5c404f80d1f6d4757f977c"
format_stamp: "Formatted at 2026-08-11 01:03:13 on dist-test-slave-42z9"
server_key: "53b64bae63e48a539175d9ebd63db971"
server_key_iv: "b64341e58b7faabc2fab5a24a92f37fb"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:14.772387 2592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:14.787856 2592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:14.790599 2592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:14.790956 2592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:14.791303 2592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:14.791755 2592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:14.791834 2592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:14.791893 2592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:14.791923 2592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:14.799360 2592 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:34759
I20260811 01:03:14.799939 2592 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:03:14.800868 2856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:34759 every 8 connection(s)
I20260811 01:03:14.802107 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 2592
I20260811 01:03:14.802426 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.30.148:43077/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:46541
--local_ip_for_outbound_sockets=127.13.30.130
--tserver_master_addrs=127.13.30.190:44481
--webserver_port=33401
--webserver_interface=127.13.30.130
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:36197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.30.148:43077/kms with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:03:14 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410194, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:14.816591 2861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:14.802208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:34561 (local address 127.13.30.190:44481)
0811 01:03:14.802431 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:14.802442 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:14.803615 (+ 1173us) server_negotiation.cc:407] Connection header received
0811 01:03:14.803779 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:14.803785 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:14.803858 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:14.804001 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:14.804924 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:14.806398 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:14.808005 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:14.808696 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:14.808813 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:14.811874 (+ 3061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:14.811881 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:14.811881 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:14.811898 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:14.814166 (+ 2268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:14.814797 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:14.814802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:14.814802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:14.814940 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:14.815292 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:14.815294 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:14.815294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:14.815691 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:14.815810 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:14.816207 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 01:03:14.816363 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":93,"threads_started":1}
I20260811 01:03:14.816603 2860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:14.802132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:44481 (local address 127.13.30.129:34561)
0811 01:03:14.802709 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:14.802759 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:14.803415 (+ 656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:14.804190 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:14.804194 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:14.804472 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:14.804777 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:14.804785 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:14.806558 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:14.806559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:14.807881 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:14.807885 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:14.808964 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:14.808966 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:14.809117 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:14.809855 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:14.809867 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:14.811702 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:14.814290 (+ 2588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:14.814303 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:14.814306 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:14.814681 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:14.815021 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:14.815022 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:14.815023 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:14.815181 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:14.815801 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:14.815809 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:14.815990 (+ 181us) client_negotiation.cc:769] Sending connection context
0811 01:03:14.816126 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 01:03:14.816327 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":171,"threads_started":1}
I20260811 01:03:14.817629 2857 heartbeater.cc:347] Connected to a master server at 127.13.30.190:44481
I20260811 01:03:14.817742 2857 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:14.817957 2857 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
W20260811 01:03:14.819005 2857 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:44481 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 01:03:14.819082 2857 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:14.819149 2857 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
I20260811 01:03:14.819669 2857 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:14.819746 2857 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
W20260811 01:03:14.820096 2857 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:03:14.913951 2866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:14.914178 2866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:14.914214 2866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:14.915723 2866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:14.915784 2866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:14.915825 2866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:03:14.917929 2866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.30.148:43077/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:46541
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=33401
--tserver_master_addrs=127.13.30.190:44481
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:14.918219 2866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:14.918563 2866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:14.924618 2872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:14.924947 2866 server_base.cc:1034] running on GCE node
W20260811 01:03:14.926041 2874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:14.926254 2871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:14.926507 2866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:14.926792 2866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:14.927974 2866 hybrid_clock.cc:648] HybridClock initialized: now 1786410194927960 us; error 28 us; skew 500 ppm
Aug 11 01:03:14 dist-test-slave-42z9 krb5kdc[882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410194, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:14.930815 2866 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:03:14.931334 2866 webserver.cc:460] Webserver started at http://127.13.30.130:33401/ using document root <none> and password file <none>
I20260811 01:03:14.931557 2866 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:14.931627 2866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 01:03:14 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410194, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:03:14.955595 2866 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:03:14.963016 2887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:14.963330 2866 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.000s sys 0.000s
I20260811 01:03:14.963455 2866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "e72da32aac9e43148600da4d92bc8729"
format_stamp: "Formatted at 2026-08-11 01:03:13 on dist-test-slave-42z9"
server_key: "ed307caa8e48cd717cfdb06c5f50df09"
server_key_iv: "aae4747199aab744f786e8e8727e3e79"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:14.964005 2866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:14.997390 2866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:15.000187 2866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:15.000478 2866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:15.000825 2866 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:15.001319 2866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:15.001430 2866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:15.001559 2866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:15.001621 2866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:15.010802 2866 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:46541
I20260811 01:03:15.011490 2866 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:03:15.012912 3078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:46541 every 8 connection(s)
Aug 11 01:03:15 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410194, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:15.021209 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 2866
I20260811 01:03:15.021871 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.30.148:43077/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:43057
--local_ip_for_outbound_sockets=127.13.30.131
--tserver_master_addrs=127.13.30.190:44481
--webserver_port=36017
--webserver_interface=127.13.30.131
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:36197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.30.148:43077/kms with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:03:15.023973 2861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:15.012766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:50531 (local address 127.13.30.190:44481)
0811 01:03:15.012813 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:15.012815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:15.013052 (+ 237us) server_negotiation.cc:407] Connection header received
0811 01:03:15.013813 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:15.013815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:15.013833 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:15.013915 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:15.014670 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:15.015448 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:15.017071 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:15.017379 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:15.017530 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:15.020328 (+ 2798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:15.020331 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:15.020331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:15.020343 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:15.022184 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:15.022781 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:15.022783 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:15.022783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:15.022849 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:15.023155 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:15.023156 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:15.023156 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:15.023300 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:15.023346 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:15.023772 (+ 426us) server_negotiation.cc:299] Negotiation successful
0811 01:03:15.023873 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 01:03:15.024552 3083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:15.012459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:44481 (local address 127.13.30.130:50531)
0811 01:03:15.012910 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:15.012958 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:15.013674 (+ 716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:15.014002 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:15.014006 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:15.014254 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:15.014543 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:15.014551 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:15.015563 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:15.015565 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:15.016962 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:15.016967 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:15.017551 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:15.017552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:15.017705 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:15.018371 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:15.018383 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:15.020203 (+ 1820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:15.022296 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:15.022307 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:15.022310 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:15.022682 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:15.022920 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:15.022921 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:15.022922 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:15.023076 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:15.023393 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:15.023401 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:15.023596 (+ 195us) client_negotiation.cc:769] Sending connection context
0811 01:03:15.024080 (+ 484us) client_negotiation.cc:240] Negotiation successful
0811 01:03:15.024276 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":89,"threads_started":1}
I20260811 01:03:15.025183 3079 heartbeater.cc:347] Connected to a master server at 127.13.30.190:44481
I20260811 01:03:15.025301 3079 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:15.025543 3079 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
W20260811 01:03:15.026249 3079 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:44481 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 01:03:15.026321 3079 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:15.026386 3079 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
I20260811 01:03:15.026739 3079 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:15.026813 3079 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
W20260811 01:03:15.027132 3079 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:03:15.138861 3084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:15.139111 3084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:15.139149 3084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:15.140506 3084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:15.140559 3084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:15.140600 3084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:03:15.142356 3084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.30.148:43077/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:43057
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=36017
--tserver_master_addrs=127.13.30.190:44481
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:15.142659 3084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:15.142917 3084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:15.149055 3097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:15.149175 3093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:15.149048 3092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:15.150151 3084 server_base.cc:1034] running on GCE node
I20260811 01:03:15.150453 3084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:15.151167 3084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:15.160863 3084 hybrid_clock.cc:648] HybridClock initialized: now 1786410195160454 us; error 400 us; skew 500 ppm
Aug 11 01:03:15 dist-test-slave-42z9 krb5kdc[882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410195, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:15.164134 3084 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:03:15.164656 3084 webserver.cc:460] Webserver started at http://127.13.30.131:36017/ using document root <none> and password file <none>
I20260811 01:03:15.164928 3084 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:15.165020 3084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 01:03:15 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410195, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:03:15.191376 3084 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.000s sys 0.001s
I20260811 01:03:15.197985 3108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:15.198213 3084 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.000s sys 0.001s
I20260811 01:03:15.198312 3084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "4b62cf8f456d4ca2849392b7b6d07b59"
format_stamp: "Formatted at 2026-08-11 01:03:14 on dist-test-slave-42z9"
server_key: "71e3ada116c5ab3355648bd412c352bd"
server_key_iv: "4a2789f096c18083475992c37cfc66ad"
server_key_version: "kuduclusterkey@0"
I20260811 01:03:15.198853 3084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:15.223650 3084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:15.225800 3084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:15.225932 3084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:15.226173 3084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:15.226555 3084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:15.226594 3084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:15.226616 3084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:15.226627 3084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:15.237521 3084 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:43057
I20260811 01:03:15.238059 3084 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:03:15.238713 3279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:43057 every 8 connection(s)
I20260811 01:03:15.244691 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 3084
Aug 11 01:03:15 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410195, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:15.248909 2861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:15.239021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:48453 (local address 127.13.30.190:44481)
0811 01:03:15.239075 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:15.239077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:15.239428 (+ 351us) server_negotiation.cc:407] Connection header received
0811 01:03:15.239960 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:15.239961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:15.239976 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:15.240038 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:15.240632 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:15.241135 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:15.242217 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:15.242430 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:15.242489 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:15.245433 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:15.245435 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:15.245472 (+ 37us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:15.245489 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:15.247191 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:15.247760 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:15.247761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:15.247762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:15.247831 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:15.248168 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:15.248169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:15.248170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:15.248313 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:15.248388 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:15.248717 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 01:03:15.248813 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 01:03:15.249105 3283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:15.239034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:44481 (local address 127.13.30.131:48453)
0811 01:03:15.239207 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:15.239244 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:15.239856 (+ 612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:15.240109 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:15.240114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:15.240326 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:15.240539 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:15.240544 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:15.241232 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:15.241232 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:15.242129 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:15.242133 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:15.242587 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:15.242588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:15.242701 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:15.243315 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:15.243324 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:15.245308 (+ 1984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:15.247284 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:15.247296 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:15.247299 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:15.247653 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:15.247901 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:15.247902 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:15.247902 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:15.248083 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:15.248393 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:15.248400 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:15.248559 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 01:03:15.248684 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 01:03:15.248852 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":108,"threads_started":1}
I20260811 01:03:15.249853 3280 heartbeater.cc:347] Connected to a master server at 127.13.30.190:44481
I20260811 01:03:15.249961 3280 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:15.250185 3280 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
W20260811 01:03:15.250872 3280 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:44481 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 01:03:15.250947 3280 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:15.251013 3280 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
I20260811 01:03:15.251307 3280 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:15.251389 3280 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
W20260811 01:03:15.251696 3280 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 01:03:15.254396 3287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:15.245146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52688 (local address 127.13.30.190:44481)
0811 01:03:15.245298 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:15.245300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:15.245755 (+ 455us) server_negotiation.cc:407] Connection header received
0811 01:03:15.245779 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:15.245780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:15.245794 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:15.245862 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:15.247291 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:15.248087 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:15.250091 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:15.250430 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:15.250498 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:15.251902 (+ 1404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:15.251903 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:15.251903 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:15.251909 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:15.253212 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:15.253634 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:15.253634 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:15.253635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:15.253686 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:15.253887 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:15.253887 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:15.253887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:15.253990 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:15.254116 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:15.254243 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 01:03:15.254319 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
Aug 11 01:03:15 dist-test-slave-42z9 krb5kdc[882](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786410195, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:15.820314 2857 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:15.820506 2857 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
I20260811 01:03:15.820940 2526 ts_manager.cc:194] Registered new tserver with Master: 19efe236ae5c404f80d1f6d4757f977c (127.13.30.129:34759)
I20260811 01:03:15.821693 2526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:34561
I20260811 01:03:16.027340 3079 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:16.027751 3079 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
I20260811 01:03:16.028360 2526 ts_manager.cc:194] Registered new tserver with Master: e72da32aac9e43148600da4d92bc8729 (127.13.30.130:46541)
I20260811 01:03:16.028904 2526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:50531
Aug 11 01:03:16 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410195, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:03:16.251881 3280 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:16.252076 3280 heartbeater.cc:511] Master 127.13.30.190:44481 requested a full tablet report, sending...
I20260811 01:03:16.252445 2526 ts_manager.cc:194] Registered new tserver with Master: 4b62cf8f456d4ca2849392b7b6d07b59 (127.13.30.131:43057)
I20260811 01:03:16.252934 2526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:48453
I20260811 01:03:16.254506 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:03:16.270920 3315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.255441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52692 (local address 127.13.30.190:44481)
0811 01:03:16.255717 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:16.255720 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:16.255851 (+ 131us) server_negotiation.cc:407] Connection header received
0811 01:03:16.255878 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:16.255879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:16.255893 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:16.255952 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:16.257012 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.258152 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.259167 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.259486 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.259566 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:16.266915 (+ 7349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:16.266917 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:16.266918 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:16.266928 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:16.268901 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:16.269368 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:16.269369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:16.269370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:16.269518 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:16.269789 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:16.269790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:16.269790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:16.269945 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:16.270035 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:16.270715 (+ 680us) server_negotiation.cc:299] Negotiation successful
0811 01:03:16.270815 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":75,"threads_started":1}
I20260811 01:03:16.273530 2526 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52692:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:03:16.275719 2526 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:03:16.302503 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.288772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34712 (local address 127.13.30.131:43057)
0811 01:03:16.289823 (+ 1051us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:16.289828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:16.291822 (+ 1994us) server_negotiation.cc:407] Connection header received
0811 01:03:16.291862 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:16.291864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:16.291880 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:16.291947 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:16.292219 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.293273 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.297001 (+ 3728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.297854 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.297927 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:16.297994 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:16.302301 (+ 4307us) server_negotiation.cc:299] Negotiation successful
0811 01:03:16.302395 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1015,"thread_start_us":63,"threads_started":1}
I20260811 01:03:16.304924 3326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.288512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:43057 (local address 127.0.0.1:34712)
0811 01:03:16.291713 (+ 3201us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:16.291722 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:16.291765 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:16.292060 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:16.292063 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:16.292066 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:16.292149 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:16.292151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.295148 (+ 2997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.295150 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:16.296901 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:16.296905 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.301883 (+ 4978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.301885 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:16.302006 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:16.302027 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 01:03:16.302103 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 01:03:16.304816 (+ 2713us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3176,"thread_start_us":100,"threads_started":1}
I20260811 01:03:16.307178 3329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.288432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:46541 (local address 127.0.0.1:50276)
0811 01:03:16.289143 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:16.289336 (+ 193us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:16.289674 (+ 338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:16.293746 (+ 4072us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:16.293748 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:16.293751 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:16.293821 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:16.293823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.298067 (+ 4244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.298069 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:16.299496 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:16.299501 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.306907 (+ 7406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.306909 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:16.306996 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:16.307003 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 01:03:16.307036 (+ 33us) client_negotiation.cc:240] Negotiation successful
0811 01:03:16.307092 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"thread_start_us":110,"threads_started":1}
I20260811 01:03:16.307437 3181 tablet_service.cc:1467] Processing CreateTablet for tablet 1cd1632970624ec3a6db0e2cd4cd546e (DEFAULT_TABLE table=test-table [id=5b5bb829f7bd41cf924d5fae15f901bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:03:16.307915 3181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cd1632970624ec3a6db0e2cd4cd546e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:16.308066 3327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.288521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50276 (local address 127.13.30.130:46541)
0811 01:03:16.291516 (+ 2995us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:16.291520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:16.291532 (+ 12us) server_negotiation.cc:407] Connection header received
0811 01:03:16.291571 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:16.291573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:16.291590 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:16.293912 (+ 2322us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:16.294008 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.295046 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.299630 (+ 4584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.301776 (+ 2146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.307632 (+ 5856us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:16.307796 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:16.307831 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 01:03:16.307891 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2952,"thread_start_us":74,"threads_started":1}
I20260811 01:03:16.308939 2965 tablet_service.cc:1467] Processing CreateTablet for tablet 1cd1632970624ec3a6db0e2cd4cd546e (DEFAULT_TABLE table=test-table [id=5b5bb829f7bd41cf924d5fae15f901bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:03:16.309371 2965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cd1632970624ec3a6db0e2cd4cd546e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:16.310257 3331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.288929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48618 (local address 127.13.30.129:34759)
0811 01:03:16.289233 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:16.289238 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:16.300244 (+ 11006us) server_negotiation.cc:407] Connection header received
0811 01:03:16.300384 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:16.300387 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:16.300406 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:16.300621 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:16.303001 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.304131 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.308378 (+ 4247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.309186 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.309240 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:16.309298 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:16.310099 (+ 801us) server_negotiation.cc:299] Negotiation successful
0811 01:03:16.310157 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":75,"threads_started":1}
I20260811 01:03:16.310693 3328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.288723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:34759 (local address 127.0.0.1:48618)
0811 01:03:16.300156 (+ 11433us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:16.300168 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:16.300283 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:16.300811 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:16.300813 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:16.300816 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:16.300887 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:16.300889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.304691 (+ 3802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.304692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:16.306284 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:16.306290 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.309901 (+ 3611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.309902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:16.309986 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:16.309992 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 01:03:16.310550 (+ 558us) client_negotiation.cc:240] Negotiation successful
0811 01:03:16.310612 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11409,"thread_start_us":68,"threads_started":1}
I20260811 01:03:16.311638 2728 tablet_service.cc:1467] Processing CreateTablet for tablet 1cd1632970624ec3a6db0e2cd4cd546e (DEFAULT_TABLE table=test-table [id=5b5bb829f7bd41cf924d5fae15f901bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:03:16.312032 2728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cd1632970624ec3a6db0e2cd4cd546e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:16.316635 3334 tablet_bootstrap.cc:492] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729: Bootstrap starting.
I20260811 01:03:16.317790 3334 tablet_bootstrap.cc:654] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:16.318056 3335 tablet_bootstrap.cc:492] T 1cd1632970624ec3a6db0e2cd4cd546e P 19efe236ae5c404f80d1f6d4757f977c: Bootstrap starting.
I20260811 01:03:16.318917 3335 tablet_bootstrap.cc:654] T 1cd1632970624ec3a6db0e2cd4cd546e P 19efe236ae5c404f80d1f6d4757f977c: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:16.319422 3334 log.cc:824] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:16.319895 3335 log.cc:824] T 1cd1632970624ec3a6db0e2cd4cd546e P 19efe236ae5c404f80d1f6d4757f977c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:16.321146 3334 tablet_bootstrap.cc:492] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729: No bootstrap required, opened a new log
I20260811 01:03:16.321317 3334 ts_tablet_manager.cc:1397] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 01:03:16.321663 3333 tablet_bootstrap.cc:492] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59: Bootstrap starting.
I20260811 01:03:16.322451 3333 tablet_bootstrap.cc:654] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:16.322921 3333 log.cc:824] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:16.324812 3334 raft_consensus.cc:348] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43057 } } peers { permanent_uuid: "19efe236ae5c404f80d1f6d4757f977c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 34759 } } peers { permanent_uuid: "e72da32aac9e43148600da4d92bc8729" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46541 } }
I20260811 01:03:16.325155 3334 raft_consensus.cc:374] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:16.325237 3334 raft_consensus.cc:729] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72da32aac9e43148600da4d92bc8729, State: Initialized, Role: FOLLOWER
I20260811 01:03:16.325482 3334 consensus_queue.cc:260] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43057 } } peers { permanent_uuid: "19efe236ae5c404f80d1f6d4757f977c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 34759 } } peers { permanent_uuid: "e72da32aac9e43148600da4d92bc8729" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46541 } }
I20260811 01:03:16.325910 3334 ts_tablet_manager.cc:1428] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 01:03:16.326078 3079 heartbeater.cc:503] Master 127.13.30.190:44481 was elected leader, sending a full tablet report...
I20260811 01:03:16.328011 3335 tablet_bootstrap.cc:492] T 1cd1632970624ec3a6db0e2cd4cd546e P 19efe236ae5c404f80d1f6d4757f977c: No bootstrap required, opened a new log
I20260811 01:03:16.328096 3335 ts_tablet_manager.cc:1397] T 1cd1632970624ec3a6db0e2cd4cd546e P 19efe236ae5c404f80d1f6d4757f977c: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260811 01:03:16.330593 3335 raft_consensus.cc:348] T 1cd1632970624ec3a6db0e2cd4cd546e P 19efe236ae5c404f80d1f6d4757f977c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43057 } } peers { permanent_uuid: "19efe236ae5c404f80d1f6d4757f977c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 34759 } } peers { permanent_uuid: "e72da32aac9e43148600da4d92bc8729" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46541 } }
I20260811 01:03:16.330803 3335 raft_consensus.cc:374] T 1cd1632970624ec3a6db0e2cd4cd546e P 19efe236ae5c404f80d1f6d4757f977c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:16.330834 3335 raft_consensus.cc:729] T 1cd1632970624ec3a6db0e2cd4cd546e P 19efe236ae5c404f80d1f6d4757f977c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19efe236ae5c404f80d1f6d4757f977c, State: Initialized, Role: FOLLOWER
I20260811 01:03:16.330971 3335 consensus_queue.cc:260] T 1cd1632970624ec3a6db0e2cd4cd546e P 19efe236ae5c404f80d1f6d4757f977c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43057 } } peers { permanent_uuid: "19efe236ae5c404f80d1f6d4757f977c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 34759 } } peers { permanent_uuid: "e72da32aac9e43148600da4d92bc8729" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46541 } }
I20260811 01:03:16.331281 3335 ts_tablet_manager.cc:1428] T 1cd1632970624ec3a6db0e2cd4cd546e P 19efe236ae5c404f80d1f6d4757f977c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:03:16.331318 2857 heartbeater.cc:503] Master 127.13.30.190:44481 was elected leader, sending a full tablet report...
I20260811 01:03:16.333118 3333 tablet_bootstrap.cc:492] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59: No bootstrap required, opened a new log
I20260811 01:03:16.333214 3333 ts_tablet_manager.cc:1397] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260811 01:03:16.335664 3333 raft_consensus.cc:348] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43057 } } peers { permanent_uuid: "19efe236ae5c404f80d1f6d4757f977c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 34759 } } peers { permanent_uuid: "e72da32aac9e43148600da4d92bc8729" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46541 } }
I20260811 01:03:16.335857 3333 raft_consensus.cc:374] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:16.335886 3333 raft_consensus.cc:729] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b62cf8f456d4ca2849392b7b6d07b59, State: Initialized, Role: FOLLOWER
I20260811 01:03:16.336020 3333 consensus_queue.cc:260] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43057 } } peers { permanent_uuid: "19efe236ae5c404f80d1f6d4757f977c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 34759 } } peers { permanent_uuid: "e72da32aac9e43148600da4d92bc8729" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46541 } }
I20260811 01:03:16.336344 3333 ts_tablet_manager.cc:1428] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 01:03:16.336717 3280 heartbeater.cc:503] Master 127.13.30.190:44481 was elected leader, sending a full tablet report...
W20260811 01:03:16.490422 3282 tablet.cc:2369] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:03:16.514361 3080 tablet.cc:2369] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 01:03:16 dist-test-slave-42z9 krb5kdc[882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410195, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for HTTP/127.13.30.148@KRBTEST.COM
I20260811 01:03:16.522733 3342 raft_consensus.cc:482] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:03:16.522892 3342 raft_consensus.cc:504] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43057 } } peers { permanent_uuid: "19efe236ae5c404f80d1f6d4757f977c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 34759 } } peers { permanent_uuid: "e72da32aac9e43148600da4d92bc8729" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46541 } }
I20260811 01:03:16.523298 3342 leader_election.cc:288] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19efe236ae5c404f80d1f6d4757f977c (127.13.30.129:34759), e72da32aac9e43148600da4d92bc8729 (127.13.30.130:46541)
I20260811 01:03:16.527859 3327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.523740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:35777 (local address 127.13.30.130:46541)
0811 01:03:16.523784 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:16.523786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:16.524262 (+ 476us) server_negotiation.cc:407] Connection header received
0811 01:03:16.524378 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:16.524379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:16.524390 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:16.524419 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:16.524687 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.525364 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.526863 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.527384 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.527438 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:16.527449 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:16.527728 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 01:03:16.527781 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 01:03:16.528211 3345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.523509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:46541 (local address 127.13.30.131:35777)
0811 01:03:16.524177 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:16.524191 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:16.524297 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:16.524510 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:16.524511 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:16.524513 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:16.524602 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:16.524604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.525507 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.525508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:16.526744 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:16.526749 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.527566 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.527567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:16.527637 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:16.527641 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:03:16.528043 (+ 402us) client_negotiation.cc:240] Negotiation successful
0811 01:03:16.528097 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":111,"threads_started":1}
I20260811 01:03:16.528656 2991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cd1632970624ec3a6db0e2cd4cd546e" candidate_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72da32aac9e43148600da4d92bc8729" is_pre_election: true
I20260811 01:03:16.528844 2991 raft_consensus.cc:2454] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b62cf8f456d4ca2849392b7b6d07b59 in term 0.
I20260811 01:03:16.529105 3111 leader_election.cc:302] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b62cf8f456d4ca2849392b7b6d07b59, e72da32aac9e43148600da4d92bc8729; no voters:
I20260811 01:03:16.529239 3342 raft_consensus.cc:2781] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:03:16.529276 3342 raft_consensus.cc:482] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:03:16.529296 3342 raft_consensus.cc:3037] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:16.530339 3342 raft_consensus.cc:504] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43057 } } peers { permanent_uuid: "19efe236ae5c404f80d1f6d4757f977c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 34759 } } peers { permanent_uuid: "e72da32aac9e43148600da4d92bc8729" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46541 } }
I20260811 01:03:16.530490 3342 leader_election.cc:288] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [CANDIDATE]: Term 1 election: Requested vote from peers 19efe236ae5c404f80d1f6d4757f977c (127.13.30.129:34759), e72da32aac9e43148600da4d92bc8729 (127.13.30.130:46541)
I20260811 01:03:16.530884 2991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cd1632970624ec3a6db0e2cd4cd546e" candidate_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e72da32aac9e43148600da4d92bc8729"
I20260811 01:03:16.530965 2991 raft_consensus.cc:3037] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:16.531744 3331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.524248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:40749 (local address 127.13.30.129:34759)
0811 01:03:16.524291 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:16.524292 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:16.528426 (+ 4134us) server_negotiation.cc:407] Connection header received
0811 01:03:16.528548 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:16.528549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:16.528561 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:16.528589 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:16.528751 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.529404 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.530695 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.531293 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.531344 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:16.531355 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:16.531614 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 01:03:16.531669 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 01:03:16.531919 2991 raft_consensus.cc:2454] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b62cf8f456d4ca2849392b7b6d07b59 in term 1.
I20260811 01:03:16.532012 3345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.524005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:34759 (local address 127.13.30.131:40749)
0811 01:03:16.528361 (+ 4356us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:16.528374 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:16.528459 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:16.528652 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:16.528653 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:16.528655 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:16.528688 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:16.528689 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.529584 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.529585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:16.530588 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:16.530592 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.531453 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.531454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:16.531532 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:16.531536 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:03:16.531879 (+ 343us) client_negotiation.cc:240] Negotiation successful
0811 01:03:16.531928 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4343,"thread_start_us":74,"threads_started":1}
I20260811 01:03:16.532390 3111 leader_election.cc:302] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b62cf8f456d4ca2849392b7b6d07b59, e72da32aac9e43148600da4d92bc8729; no voters:
I20260811 01:03:16.532483 3342 raft_consensus.cc:2781] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:03:16.532464 2752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cd1632970624ec3a6db0e2cd4cd546e" candidate_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19efe236ae5c404f80d1f6d4757f977c"
I20260811 01:03:16.532517 2750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1cd1632970624ec3a6db0e2cd4cd546e" candidate_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19efe236ae5c404f80d1f6d4757f977c" is_pre_election: true
I20260811 01:03:16.532584 2752 raft_consensus.cc:3037] T 1cd1632970624ec3a6db0e2cd4cd546e P 19efe236ae5c404f80d1f6d4757f977c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:16.532647 3342 raft_consensus.cc:686] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [term 1 LEADER]: Becoming Leader. State: Replica: 4b62cf8f456d4ca2849392b7b6d07b59, State: Running, Role: LEADER
I20260811 01:03:16.532737 3342 consensus_queue.cc:237] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43057 } } peers { permanent_uuid: "19efe236ae5c404f80d1f6d4757f977c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 34759 } } peers { permanent_uuid: "e72da32aac9e43148600da4d92bc8729" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46541 } }
I20260811 01:03:16.533499 2752 raft_consensus.cc:2454] T 1cd1632970624ec3a6db0e2cd4cd546e P 19efe236ae5c404f80d1f6d4757f977c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b62cf8f456d4ca2849392b7b6d07b59 in term 1.
I20260811 01:03:16.533744 2526 catalog_manager.cc:5495] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b62cf8f456d4ca2849392b7b6d07b59 (127.13.30.131). New cstate: current_term: 1 leader_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b62cf8f456d4ca2849392b7b6d07b59" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19efe236ae5c404f80d1f6d4757f977c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 34759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e72da32aac9e43148600da4d92bc8729" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46541 } health_report { overall_health: UNKNOWN } } }
W20260811 01:03:16.552487 2859 tablet.cc:2369] T 1cd1632970624ec3a6db0e2cd4cd546e P 19efe236ae5c404f80d1f6d4757f977c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:03:16.575513 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.572383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34724 (local address 127.13.30.131:43057)
0811 01:03:16.572425 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:16.572427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:16.572434 (+ 7us) server_negotiation.cc:407] Connection header received
0811 01:03:16.572477 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:16.572478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:16.572500 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:16.572567 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:03:16.572772 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.573497 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.574423 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:16.574708 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:16.574773 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:16.574987 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:03:16.575133 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:03:16.575207 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:16.575385 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 01:03:16.575414 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 01:03:16.581306 2991 raft_consensus.cc:1261] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729 [term 1 FOLLOWER]: Refusing update from remote peer 4b62cf8f456d4ca2849392b7b6d07b59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:03:16.581388 2752 raft_consensus.cc:1261] T 1cd1632970624ec3a6db0e2cd4cd546e P 19efe236ae5c404f80d1f6d4757f977c [term 1 FOLLOWER]: Refusing update from remote peer 4b62cf8f456d4ca2849392b7b6d07b59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:03:16.581751 3342 consensus_queue.cc:1035] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19efe236ae5c404f80d1f6d4757f977c" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 34759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:03:16.581909 3347 consensus_queue.cc:1035] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e72da32aac9e43148600da4d92bc8729" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:03:16.589107 3359 mvcc.cc:205] Tried to move back new op lower bound from 7317136165193527296 to 7317136164998647808. Current Snapshot: MvccSnapshot[applied={T|T < 7317136165193527296}]
I20260811 01:03:16.591352 3356 mvcc.cc:205] Tried to move back new op lower bound from 7317136165193527296 to 7317136164998647808. Current Snapshot: MvccSnapshot[applied={T|T < 7317136165193527296}]
I20260811 01:03:16.593134 3358 mvcc.cc:205] Tried to move back new op lower bound from 7317136165193527296 to 7317136164998647808. Current Snapshot: MvccSnapshot[applied={T|T < 7317136165193527296 or (T in {7317136165193527296})}]
I20260811 01:03:16.594645 2526 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52692:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:03:16.594759 2526 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52692:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:03:16.595583 2526 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6afe55337e694553b00dbc984ff7111c: Sending DeleteTablet for 3 replicas of tablet 1cd1632970624ec3a6db0e2cd4cd546e
I20260811 01:03:16.596099 3181 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cd1632970624ec3a6db0e2cd4cd546e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:03:16 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:34712
I20260811 01:03:16.596612 2965 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cd1632970624ec3a6db0e2cd4cd546e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:03:16 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:50276
I20260811 01:03:16.597169 2728 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cd1632970624ec3a6db0e2cd4cd546e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:03:16 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:48618
I20260811 01:03:16.597962 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 2592
I20260811 01:03:16.634333 3374 tablet_replica.cc:330] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59: stopping tablet replica
I20260811 01:03:16.634560 3374 raft_consensus.cc:2229] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:03:16.634697 3374 raft_consensus.cc:2258] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:03:16.634922 3375 tablet_replica.cc:330] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729: stopping tablet replica
I20260811 01:03:16.635066 3375 raft_consensus.cc:2229] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:03:16.635205 3375 raft_consensus.cc:2258] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:03:16.646214 3374 ts_tablet_manager.cc:1905] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:03:16.648142 3374 ts_tablet_manager.cc:1918] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:03:16.648243 3374 log.cc:1196] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/1cd1632970624ec3a6db0e2cd4cd546e
I20260811 01:03:16.648514 3374 ts_tablet_manager.cc:1939] T 1cd1632970624ec3a6db0e2cd4cd546e P 4b62cf8f456d4ca2849392b7b6d07b59: Deleting consensus metadata
I20260811 01:03:16.649096 2506 catalog_manager.cc:4841] TS 4b62cf8f456d4ca2849392b7b6d07b59 (127.13.30.131:43057): tablet 1cd1632970624ec3a6db0e2cd4cd546e (table test-table [id=5b5bb829f7bd41cf924d5fae15f901bf]) successfully deleted
I20260811 01:03:16.649799 3375 ts_tablet_manager.cc:1905] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:03:16.651583 3375 ts_tablet_manager.cc:1918] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:03:16.651688 3375 log.cc:1196] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/1cd1632970624ec3a6db0e2cd4cd546e
I20260811 01:03:16.651983 3375 ts_tablet_manager.cc:1939] T 1cd1632970624ec3a6db0e2cd4cd546e P e72da32aac9e43148600da4d92bc8729: Deleting consensus metadata
I20260811 01:03:16.652561 2505 catalog_manager.cc:4841] TS e72da32aac9e43148600da4d92bc8729 (127.13.30.130:46541): tablet 1cd1632970624ec3a6db0e2cd4cd546e (table test-table [id=5b5bb829f7bd41cf924d5fae15f901bf]) successfully deleted
W20260811 01:03:16.660444 2507 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:34759 (error 108)
I20260811 01:03:16.668569 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 2866
I20260811 01:03:16.679317 3328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.679094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:34759 (local address 127.0.0.1:48630)
0811 01:03:16.679161 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:16.679239 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:34759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 01:03:16.683444 2507 catalog_manager.cc:4584] TS 19efe236ae5c404f80d1f6d4757f977c (127.13.30.129:34759): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1cd1632970624ec3a6db0e2cd4cd546e: Network error: Client connection negotiation failed: client connection to 127.13.30.129:34759: connect: Connection refused (error 111)
I20260811 01:03:16.691609 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 3084
I20260811 01:03:16.810379 3328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.810203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:34759 (local address 127.0.0.1:48634)
0811 01:03:16.810269 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:16.810325 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:34759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 01:03:16.810765 3328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:16.810680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:34759 (local address 127.0.0.1:48646)
0811 01:03:16.810716 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:16.810738 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:34759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 01:03:16.829782 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 2478
I20260811 01:03:16.846817 13434 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 01:03:17.192752 13434 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 01:03:17.192867 13434 mini_ranger.cc:66] Stopping Ranger...
I20260811 01:03:17.548180 13434 mini_ranger.cc:68] Stopped Ranger
2026-08-11 01:03:17.548 UTC [940] LOG: received smart shutdown request
2026-08-11 01:03:17.553 UTC [940] LOG: background worker "logical replication launcher" (PID 954) exited with exit code 1
2026-08-11 01:03:17.553 UTC [946] LOG: shutting down
2026-08-11 01:03:17.723 UTC [940] LOG: database system is shut down
2026-08-11T01:03:17Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52772 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:03:17 dist-test-slave-42z9 krb5kdc[3394](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:03:17 dist-test-slave-42z9 krb5kdc[3394](info): set up 2 sockets
Aug 11 01:03:17 dist-test-slave-42z9 krb5kdc[3394](info): commencing operation
krb5kdc: starting...
W20260811 01:03:19.000337 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:03:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:03:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:03:19.130774 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:36971
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:41515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:36971,127.13.30.189:37651,127.13.30.188:45027
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:19.220237 3422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:19.220487 3422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:19.220520 3422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:19.221818 3422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:03:19.221872 3422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:19.221894 3422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:19.221910 3422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:03:19.221927 3422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:03:19.223613 3422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:41515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:36971,127.13.30.189:37651,127.13.30.188:45027
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:36971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:19.223906 3422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:19.224143 3422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:19.229219 3429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:19.229219 3431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:19.229242 3428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:19.229278 3422 server_base.cc:1034] running on GCE node
I20260811 01:03:19.229745 3422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:19.230046 3422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:19.231189 3422 hybrid_clock.cc:648] HybridClock initialized: now 1786410199231175 us; error 31 us; skew 500 ppm
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:19.233681 3422 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:03:19.234129 3422 webserver.cc:460] Webserver started at http://127.13.30.190:34937/ using document root <none> and password file <none>
I20260811 01:03:19.234331 3422 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:19.234380 3422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:19.234511 3422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:03:19.235594 3422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "df57c9f09fc542ecb3b8c777f5b00892"
format_stamp: "Formatted at 2026-08-11 01:03:19 on dist-test-slave-42z9"
server_key: "b4a2e26fd17e8b1355165b92a6e4b5f7"
server_key_iv: "1840623ad4bd6bb7e5f733c8b256f39a"
server_key_version: "encryptionkey@0"
I20260811 01:03:19.235944 3422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "df57c9f09fc542ecb3b8c777f5b00892"
format_stamp: "Formatted at 2026-08-11 01:03:19 on dist-test-slave-42z9"
server_key: "b4a2e26fd17e8b1355165b92a6e4b5f7"
server_key_iv: "1840623ad4bd6bb7e5f733c8b256f39a"
server_key_version: "encryptionkey@0"
I20260811 01:03:19.237339 3422 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 01:03:19.238147 3442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:19.238315 3422 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:19.238423 3422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "df57c9f09fc542ecb3b8c777f5b00892"
format_stamp: "Formatted at 2026-08-11 01:03:19 on dist-test-slave-42z9"
server_key: "b4a2e26fd17e8b1355165b92a6e4b5f7"
server_key_iv: "1840623ad4bd6bb7e5f733c8b256f39a"
server_key_version: "encryptionkey@0"
I20260811 01:03:19.238490 3422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:19.249158 3422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:19.251121 3422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:19.251276 3422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:19.255415 3422 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:36971
I20260811 01:03:19.255481 3511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:36971 every 8 connection(s)
I20260811 01:03:19.255837 3422 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:03:19.256754 3512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:19.257016 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 3422
I20260811 01:03:19.257108 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:03:19.257283 13434 external_mini_cluster.cc:1428] Setting key 9e88c845fb54a1397f3c71b88cce9fdd
I20260811 01:03:19.258562 3512 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.30.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.189@KRBTEST.COM" created.
I20260811 01:03:19.269340 3519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.259394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56958 (local address 127.13.30.190:36971)
0811 01:03:19.259627 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.259631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.259734 (+ 103us) server_negotiation.cc:407] Connection header received
0811 01:03:19.260503 (+ 769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.260506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.260530 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.260627 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.261203 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.262627 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.263526 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.264028 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.264142 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.266325 (+ 2183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.266333 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.266333 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.266341 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.267748 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.268167 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.268170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.268170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.268250 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.268442 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.268443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.268443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.268759 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.268842 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.269023 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.269144 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":85,"threads_started":1}
I20260811 01:03:19.269359 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.259362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:36971 (local address 127.0.0.1:56958)
0811 01:03:19.259560 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.259617 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:19.260327 (+ 710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:19.260636 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:19.260638 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:19.260905 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:19.261096 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.261100 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.262723 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.262724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.263429 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.263432 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.264110 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.264110 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.264182 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.264743 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:19.264753 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:19.266240 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:19.267824 (+ 1584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.267832 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.267834 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.268098 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.268298 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.268299 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.268299 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.268381 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.268823 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:19.268830 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:19.268895 (+ 65us) client_negotiation.cc:769] Sending connection context
0811 01:03:19.268987 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 01:03:19.269241 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":87,"thread_start_us":96,"threads_started":1}
I20260811 01:03:19.270145 3512 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:03:19.270555 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.270422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37651 (local address 127.0.0.1:53018)
0811 01:03:19.270468 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.270525 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 01:03:19.270716 3444 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37651: connect: Connection refused (error 111)
I20260811 01:03:19.271191 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.271101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37651 (local address 127.0.0.1:53020)
0811 01:03:19.271146 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.271174 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 01:03:19.271306 3512 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.189:37651: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37651: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.189.keytab.
Entry for principal kudu/127.13.30.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.189.keytab.
I20260811 01:03:19.285257 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.189:37651
--webserver_interface=127.13.30.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.189.keytab
--principal=kudu/127.13.30.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:41515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:36971,127.13.30.189:37651,127.13.30.188:45027
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:03:19.320520 3512 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } attempt: 1
I20260811 01:03:19.321062 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.320886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37651 (local address 127.0.0.1:53026)
0811 01:03:19.320960 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.321018 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 01:03:19.321403 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.321304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37651 (local address 127.0.0.1:53030)
0811 01:03:19.321349 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.321379 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 01:03:19.321599 3512 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.189:37651: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37651: connect: Connection refused (error 111)
W20260811 01:03:19.371021 3524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:19.371263 3524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:19.371287 3524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:19.372545 3524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:03:19.372601 3524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:19.372613 3524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:19.372627 3524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:03:19.372640 3524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:03:19.374405 3524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:41515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:36971,127.13.30.189:37651,127.13.30.188:45027
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.189.keytab
--principal=kudu/127.13.30.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.189:37651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.30.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:19.374701 3524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:19.374960 3524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:19.380218 3539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:19.380209 3537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:19.380208 3534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:19.380491 3524 server_base.cc:1034] running on GCE node
I20260811 01:03:19.380774 3524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:19.381103 3524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:19.382280 3524 hybrid_clock.cc:648] HybridClock initialized: now 1786410199382264 us; error 31 us; skew 500 ppm
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:19.384863 3524 init.cc:377] Logged in from keytab as kudu/127.13.30.189@KRBTEST.COM (short username kudu)
I20260811 01:03:19.385358 3524 webserver.cc:460] Webserver started at http://127.13.30.189:38639/ using document root <none> and password file <none>
I20260811 01:03:19.385639 3524 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:19.385689 3524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:19.385819 3524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:03:19.386925 3524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/data/instance:
uuid: "b88e3adc873d476c865858cde44acff4"
format_stamp: "Formatted at 2026-08-11 01:03:19 on dist-test-slave-42z9"
server_key: "0317badd39c00ab69974ea98349a17ca"
server_key_iv: "1a2db0159d955147780c176f0c502321"
server_key_version: "encryptionkey@0"
I20260811 01:03:19.387274 3524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/wal/instance:
uuid: "b88e3adc873d476c865858cde44acff4"
format_stamp: "Formatted at 2026-08-11 01:03:19 on dist-test-slave-42z9"
server_key: "0317badd39c00ab69974ea98349a17ca"
server_key_iv: "1a2db0159d955147780c176f0c502321"
server_key_version: "encryptionkey@0"
I20260811 01:03:19.388707 3524 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:03:19.389422 3551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:19.389621 3524 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:19.389714 3524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/wal
uuid: "b88e3adc873d476c865858cde44acff4"
format_stamp: "Formatted at 2026-08-11 01:03:19 on dist-test-slave-42z9"
server_key: "0317badd39c00ab69974ea98349a17ca"
server_key_iv: "1a2db0159d955147780c176f0c502321"
server_key_version: "encryptionkey@0"
I20260811 01:03:19.389747 3512 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } attempt: 2
I20260811 01:03:19.389779 3524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:19.390170 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.390023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37651 (local address 127.0.0.1:53032)
0811 01:03:19.390086 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.390132 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 01:03:19.390473 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.390387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37651 (local address 127.0.0.1:53048)
0811 01:03:19.390415 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.390443 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260811 01:03:19.390559 3512 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.189:37651: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37651: connect: Connection refused (error 111)
I20260811 01:03:19.410161 3524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:19.412243 3524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:19.412389 3524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:19.416571 3524 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.189:37651
I20260811 01:03:19.416610 3639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.189:37651 every 8 connection(s)
I20260811 01:03:19.416976 3524 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/data/info.pb
I20260811 01:03:19.417953 3640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:19.419631 3640 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:03:19.421685 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 3524
I20260811 01:03:19.421764 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-1/wal/instance
I20260811 01:03:19.421926 13434 external_mini_cluster.cc:1428] Setting key 293d90f713ea209cb35ec0b21eb03de0
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.189@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:19.428917 3519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.420405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56964 (local address 127.13.30.190:36971)
0811 01:03:19.420470 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.420472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.420676 (+ 204us) server_negotiation.cc:407] Connection header received
0811 01:03:19.421167 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.421168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.421180 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.421242 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.422065 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.422564 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.423551 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.423763 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.423823 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.426039 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.426040 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.426040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.426050 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.427575 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.427991 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.427992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.427993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.428062 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.428271 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.428272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.428272 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.428419 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.428499 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.428717 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.428817 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 01:03:19.429008 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.420353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:36971 (local address 127.0.0.1:56964)
0811 01:03:19.420549 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.420594 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:19.421086 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:19.421312 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:19.421315 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:19.421671 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:19.421932 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.421938 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.422656 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.422657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.423462 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.423465 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.423838 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.423839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.423972 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.424497 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:19.424506 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:19.425927 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:19.427660 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.427668 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.427670 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.427910 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.428124 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.428125 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.428125 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.428220 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.428477 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:19.428480 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:19.428602 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 01:03:19.428680 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 01:03:19.428813 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":100,"threads_started":1}
I20260811 01:03:19.429644 3640 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.13.30.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.188@KRBTEST.COM" created.
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.189@KRBTEST.COM for kudu/127.13.30.189@KRBTEST.COM
I20260811 01:03:19.437004 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.429908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37651 (local address 127.0.0.1:53062)
0811 01:03:19.429955 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.429966 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:19.430007 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:19.430341 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:19.430342 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:19.430464 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:19.430521 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.430522 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.431546 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.431547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.432075 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.432077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.432506 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.432507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.432571 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.433020 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:19.433026 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:19.434334 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:19.435993 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.435994 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.435995 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.436198 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.436373 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.436374 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.436374 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.436429 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.436746 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:19.436747 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:19.436784 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 01:03:19.436830 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:03:19.436918 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 01:03:19.437106 3644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.429983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53062 (local address 127.13.30.189:37651)
0811 01:03:19.430175 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.430180 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.430206 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:03:19.430231 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.430233 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.430250 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.430334 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.430585 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.431440 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.432137 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.432436 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.432486 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.434438 (+ 1952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.434448 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.434449 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.434457 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.435908 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.436270 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.436273 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.436273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.436322 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.436482 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.436482 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.436483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.436687 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.436767 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.436865 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.436981 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":159,"thread_start_us":111,"threads_started":1}
I20260811 01:03:19.437726 3640 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:03:19.438094 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.437953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45027 (local address 127.0.0.1:53992)
0811 01:03:19.438003 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.438068 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 01:03:19.438251 3554 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
I20260811 01:03:19.438680 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.438580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45027 (local address 127.0.0.1:54006)
0811 01:03:19.438626 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.438656 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 01:03:19.438791 3640 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:45027: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.188.keytab.
Entry for principal kudu/127.13.30.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.188.keytab.
I20260811 01:03:19.450400 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.188:45027
--webserver_interface=127.13.30.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.188.keytab
--principal=kudu/127.13.30.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:41515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:36971,127.13.30.189:37651,127.13.30.188:45027
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:03:19.481710 3512 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } attempt: 3
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for kudu/127.13.30.189@KRBTEST.COM
I20260811 01:03:19.488010 3640 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } attempt: 1
I20260811 01:03:19.488421 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.488291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45027 (local address 127.0.0.1:54014)
0811 01:03:19.488349 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.488380 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 01:03:19.488781 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.488679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45027 (local address 127.0.0.1:54022)
0811 01:03:19.488727 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.488750 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 01:03:19.488958 3640 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:45027: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
I20260811 01:03:19.489566 3644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.482225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53076 (local address 127.13.30.189:37651)
0811 01:03:19.482300 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.482302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.482336 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:03:19.482365 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.482366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.482381 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.482427 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.482744 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.483577 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.484286 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.484622 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.484692 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.486804 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.486807 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.486807 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.486817 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.488336 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.488724 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.488726 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.488726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.488783 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.489029 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.489030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.489031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.489159 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.489221 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.489372 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.489480 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 01:03:19.489574 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.482164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37651 (local address 127.0.0.1:53076)
0811 01:03:19.482224 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.482238 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:19.482301 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:19.482446 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:19.482447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:19.482608 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:19.482674 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.482676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.483679 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.483680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.484206 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.484208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.484688 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.484688 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.484742 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.485236 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:19.485240 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:19.486710 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:19.488436 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.488438 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.488438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.488654 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.488846 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.488847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.488847 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.488905 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.489220 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:19.489221 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:19.489278 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 01:03:19.489340 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 01:03:19.489478 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 01:03:19.489924 3512 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:03:19.490252 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.490161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45027 (local address 127.0.0.1:54024)
0811 01:03:19.490205 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.490232 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 01:03:19.490568 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.490482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45027 (local address 127.0.0.1:54038)
0811 01:03:19.490520 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.490544 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 01:03:19.490746 3512 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:45027: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
I20260811 01:03:19.521914 3512 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } attempt: 1
I20260811 01:03:19.522455 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.522322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45027 (local address 127.0.0.1:54046)
0811 01:03:19.522386 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.522419 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 01:03:19.522814 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.522724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45027 (local address 127.0.0.1:54052)
0811 01:03:19.522767 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.522794 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 01:03:19.522898 3512 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:45027: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
W20260811 01:03:19.538610 3647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:19.538861 3647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:19.538894 3647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:19.540184 3647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:03:19.540235 3647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:19.540254 3647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:19.540269 3647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:03:19.540284 3647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:03:19.542073 3647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:41515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:36971,127.13.30.189:37651,127.13.30.188:45027
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.188.keytab
--principal=kudu/127.13.30.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.188:45027
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.30.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:19.542353 3647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:19.542584 3647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:19.547648 3656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:19.547727 3647 server_base.cc:1034] running on GCE node
W20260811 01:03:19.547648 3652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:19.547657 3653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:19.548205 3647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:19.548511 3647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:19.549649 3647 hybrid_clock.cc:648] HybridClock initialized: now 1786410199549636 us; error 29 us; skew 500 ppm
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:19.552125 3647 init.cc:377] Logged in from keytab as kudu/127.13.30.188@KRBTEST.COM (short username kudu)
I20260811 01:03:19.552589 3647 webserver.cc:460] Webserver started at http://127.13.30.188:43709/ using document root <none> and password file <none>
I20260811 01:03:19.552815 3647 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:19.552863 3647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:19.552995 3647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:03:19.554118 3647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/data/instance:
uuid: "01442d9b43fe4c5a990800a355293381"
format_stamp: "Formatted at 2026-08-11 01:03:19 on dist-test-slave-42z9"
server_key: "07a703c4dc233323981188a8b8428cb5"
server_key_iv: "bfd36d497d9d090a6675cdaf8fc14050"
server_key_version: "encryptionkey@0"
I20260811 01:03:19.554471 3647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/wal/instance:
uuid: "01442d9b43fe4c5a990800a355293381"
format_stamp: "Formatted at 2026-08-11 01:03:19 on dist-test-slave-42z9"
server_key: "07a703c4dc233323981188a8b8428cb5"
server_key_iv: "bfd36d497d9d090a6675cdaf8fc14050"
server_key_version: "encryptionkey@0"
I20260811 01:03:19.555763 3647 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:03:19.556537 3667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:19.556692 3647 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:19.556782 3647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/wal
uuid: "01442d9b43fe4c5a990800a355293381"
format_stamp: "Formatted at 2026-08-11 01:03:19 on dist-test-slave-42z9"
server_key: "07a703c4dc233323981188a8b8428cb5"
server_key_iv: "bfd36d497d9d090a6675cdaf8fc14050"
server_key_version: "encryptionkey@0"
I20260811 01:03:19.556849 3647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:19.557102 3640 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } attempt: 2
I20260811 01:03:19.557548 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.557389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45027 (local address 127.0.0.1:54060)
0811 01:03:19.557461 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.557512 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 01:03:19.557893 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.557818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45027 (local address 127.0.0.1:54066)
0811 01:03:19.557853 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.557877 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 01:03:19.557971 3640 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:45027: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45027: connect: Connection refused (error 111)
I20260811 01:03:19.570469 3647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:19.572738 3647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:19.572868 3647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:19.576879 3647 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.188:45027
I20260811 01:03:19.576943 3750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.188:45027 every 8 connection(s)
I20260811 01:03:19.577291 3647 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/data/info.pb
I20260811 01:03:19.578308 3751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:19.580067 3751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.188@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:19.586495 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 3647
I20260811 01:03:19.586583 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786410030080353-13434-0/minicluster-data/master-2/wal/instance
I20260811 01:03:19.586751 13434 external_mini_cluster.cc:1428] Setting key 2d8d29eef6091909b23ba2829268a69f
I20260811 01:03:19.589972 3519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.580847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56976 (local address 127.13.30.190:36971)
0811 01:03:19.580916 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.580918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.581131 (+ 213us) server_negotiation.cc:407] Connection header received
0811 01:03:19.581709 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.581710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.581722 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.581765 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.582410 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.582905 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.583830 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.584032 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.584083 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.586956 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.586958 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.586959 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.586966 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.588485 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.588962 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.588963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.588963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.589012 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.589280 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.589281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.589282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.589435 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.589532 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.589778 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.589870 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 01:03:19.590142 3753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.580817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:36971 (local address 127.0.0.1:56976)
0811 01:03:19.581009 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.581052 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:19.581607 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:19.581836 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:19.581840 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:19.582114 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:19.582331 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.582336 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.582973 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.582974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.583764 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.583766 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.584094 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.584095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.584205 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.584677 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:19.584686 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:19.586827 (+ 2141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:19.588569 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.588575 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.588578 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.588894 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.589061 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.589062 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.589062 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.589223 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.589523 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:19.589528 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:19.589659 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 01:03:19.589744 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 01:03:19.589877 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":96,"threads_started":1}
I20260811 01:03:19.590682 3751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.188@KRBTEST.COM
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.188@KRBTEST.COM for kudu/127.13.30.189@KRBTEST.COM
I20260811 01:03:19.596274 3755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.587163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54082 (local address 127.13.30.188:45027)
0811 01:03:19.587341 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.587347 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.587375 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:03:19.587423 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.587427 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.587444 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.587512 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.588211 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.589133 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.590096 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.590558 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.590617 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.593314 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.593325 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.593325 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.593332 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.595106 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.595467 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.595470 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.595470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.595523 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.595706 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.595708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.595708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.595865 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.596019 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.596090 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.596169 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":91,"threads_started":1}
I20260811 01:03:19.597791 3753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.590931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37651 (local address 127.0.0.1:53082)
0811 01:03:19.590983 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.590994 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:19.591034 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:19.591164 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:19.591165 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:19.591283 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:19.591330 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.591331 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.592201 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.592202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.593029 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.593032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.593435 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.593462 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.593546 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.593973 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:19.593977 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:19.595274 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:19.596823 (+ 1549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.596824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.596824 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.597024 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.597217 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.597218 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.597218 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.597282 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.597569 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:19.597570 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:19.597604 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:03:19.597653 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 01:03:19.597726 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 01:03:19.597863 3644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.591012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53082 (local address 127.13.30.189:37651)
0811 01:03:19.591061 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.591063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.591071 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:03:19.591096 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.591097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.591108 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.591160 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.591398 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.592133 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.593115 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.593355 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.593415 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.595367 (+ 1952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.595368 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.595369 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.595377 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.596747 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.597095 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.597097 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.597097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.597164 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.597338 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.597339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.597339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.597504 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.597580 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.597679 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.597758 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 01:03:19.598028 3512 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } attempt: 2
I20260811 01:03:19.598382 3751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for kudu/127.13.30.188@KRBTEST.COM
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.188@KRBTEST.COM for kudu/127.13.30.188@KRBTEST.COM
I20260811 01:03:19.605095 3519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.597135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56980 (local address 127.13.30.190:36971)
0811 01:03:19.597174 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.597176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.597183 (+ 7us) server_negotiation.cc:407] Connection header received
0811 01:03:19.597211 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.597212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.597222 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.597273 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.597860 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.598561 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.599699 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.599999 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.600067 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.602558 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.602560 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.602560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.602569 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.603989 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.604358 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.604359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.604360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.604430 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.604629 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.604630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.604630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.604759 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.604922 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.604957 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.605024 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 01:03:19.606773 3518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.598341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45027 (local address 127.0.0.1:54088)
0811 01:03:19.598382 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.598393 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:19.598442 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:19.598678 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:19.598679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:19.598815 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:19.598852 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.598853 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.599479 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.599480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.601109 (+ 1629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.601113 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.601597 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.601598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.601663 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.602040 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:19.602044 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:19.603454 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:19.605479 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.605480 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.605481 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.605701 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.605980 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.605981 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.605981 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.606048 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.606504 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:19.606505 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:19.606552 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 01:03:19.606598 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:03:19.606678 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 01:03:19.607167 3755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.598519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54088 (local address 127.13.30.188:45027)
0811 01:03:19.598568 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.598570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.598578 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:03:19.598598 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.598598 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.598608 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.598658 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.598917 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.599407 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.601198 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.601521 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.601585 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.603538 (+ 1953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.603539 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.603539 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.603547 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.605072 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.605855 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.605856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.605857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.605914 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.606120 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.606122 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.606122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.606423 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.606962 (+ 539us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.607000 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.607080 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 01:03:19.607499 3753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.598608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45027 (local address 127.0.0.1:54092)
0811 01:03:19.598668 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.598677 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:19.598707 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:19.598909 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:19.598909 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:19.599050 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:19.599088 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.599090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.599904 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.599905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.600561 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.600564 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.602223 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.602224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.602281 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.602783 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:19.602787 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:19.604224 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:19.606309 (+ 2085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.606310 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.606311 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.606519 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.606708 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.606709 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.606709 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.606768 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.607011 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:19.607012 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:19.607042 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 01:03:19.607082 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 01:03:19.607156 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 01:03:19.607511 3756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.598642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54092 (local address 127.13.30.188:45027)
0811 01:03:19.598806 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.598808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.598813 (+ 5us) server_negotiation.cc:407] Connection header received
0811 01:03:19.598828 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.598828 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.598836 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.599147 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.599180 (+ 33us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.599840 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.600635 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.602142 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.602204 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.604301 (+ 2097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.604302 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.604302 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.604308 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.606245 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.606584 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.606585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.606585 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.606643 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.606833 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.606834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.606834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.606947 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.607204 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.607239 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.607302 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":117,"threads_started":1}
I20260811 01:03:19.609098 3512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892: Bootstrap starting.
I20260811 01:03:19.609957 3512 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:19.610312 3512 log.cc:824] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892: Log is configured to *not* fsync() on all Append() calls
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.189@KRBTEST.COM
I20260811 01:03:19.611217 3512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892: No bootstrap required, opened a new log
I20260811 01:03:19.612061 3751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381: Bootstrap starting.
I20260811 01:03:19.612871 3751 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:19.613198 3751 log.cc:824] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:19.613404 3644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.606175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53092 (local address 127.13.30.189:37651)
0811 01:03:19.606221 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.606223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.606230 (+ 7us) server_negotiation.cc:407] Connection header received
0811 01:03:19.606254 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.606255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.606265 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.606319 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.606782 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.607437 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.608230 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.608500 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.608577 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.610907 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.610909 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.610909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.610918 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.612307 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.612624 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.612625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.612625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.612681 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.612850 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.612850 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.612851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.612987 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.613196 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.613235 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.613309 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 01:03:19.613385 3512 raft_consensus.cc:348] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } }
I20260811 01:03:19.613566 3512 raft_consensus.cc:374] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:19.613610 3512 raft_consensus.cc:729] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df57c9f09fc542ecb3b8c777f5b00892, State: Initialized, Role: FOLLOWER
I20260811 01:03:19.613729 3512 consensus_queue.cc:260] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } }
I20260811 01:03:19.614022 3761 sys_catalog.cc:455] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } } }
I20260811 01:03:19.614212 3761 sys_catalog.cc:458] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:03:19.614104 3512 sys_catalog.cc:564] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:03:19.614333 3751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381: No bootstrap required, opened a new log
I20260811 01:03:19.615272 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 01:03:19.616243 3784 catalog_manager.cc:1558] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:03:19.616295 3784 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:03:19.616298 3751 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } }
I20260811 01:03:19.616432 3751 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:19.616463 3751 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01442d9b43fe4c5a990800a355293381, State: Initialized, Role: FOLLOWER
I20260811 01:03:19.616577 3751 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } }
I20260811 01:03:19.616886 3751 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:03:19.617398 3793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } } }
I20260811 01:03:19.617519 3793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:03:19.617774 3422 master_runner.cc:186] Error getting master registration for 127.13.30.189:37651: OK, instance_id { permanent_uuid: "b88e3adc873d476c865858cde44acff4" instance_seqno: 1786410199415373 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:03:19.620137 3422 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:03:19.621937 3647 master_runner.cc:186] Error getting master registration for 127.13.30.189:37651: OK, instance_id { permanent_uuid: "b88e3adc873d476c865858cde44acff4" instance_seqno: 1786410199415373 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:03:19.624294 3647 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 01:03:19.626329 3809 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:03:19.626391 3809 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:03:19.628453 3644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.616800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53096 (local address 127.13.30.189:37651)
0811 01:03:19.616841 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.616842 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.617705 (+ 863us) server_negotiation.cc:407] Connection header received
0811 01:03:19.617797 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.617798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.617809 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.617836 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.618739 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.619216 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.619925 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.620127 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.620183 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.625354 (+ 5171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.625356 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.625356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.625365 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.627115 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.627521 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.627523 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.627523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.627588 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.627808 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.627809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.627809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.627960 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.628041 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.628259 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.628358 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 01:03:19.628774 3519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.620746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56994 (local address 127.13.30.190:36971)
0811 01:03:19.620790 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.620792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.621212 (+ 420us) server_negotiation.cc:407] Connection header received
0811 01:03:19.621299 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.621300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.621309 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.621337 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.622050 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.622767 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.623791 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.624104 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.624145 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.625961 (+ 1816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.625962 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.625962 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.625970 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.627517 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.627915 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.627916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.627916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.627991 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.628195 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.628196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.628197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.628327 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.628391 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.628599 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.628685 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 01:03:19.629657 3756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.617128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54102 (local address 127.13.30.188:45027)
0811 01:03:19.617166 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.617168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.621083 (+ 3915us) server_negotiation.cc:407] Connection header received
0811 01:03:19.621134 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.621135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.621147 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.621198 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.621880 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.623138 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.624079 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.624376 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.624421 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.626655 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.626657 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.626657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.626665 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.628404 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.628765 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.628766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.628766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.628823 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.629021 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.629021 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.629022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.629142 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.629250 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.629477 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.629574 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 01:03:19.649106 3640 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } attempt: 3
Aug 11 01:03:19 dist-test-slave-42z9 krb5kdc[3394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410199, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.189@KRBTEST.COM for kudu/127.13.30.188@KRBTEST.COM
I20260811 01:03:19.658705 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.649548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45027 (local address 127.0.0.1:52962)
0811 01:03:19.649618 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:19.649631 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:19.649682 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:19.649876 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:19.649877 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:19.650105 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:19.650177 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.650179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.651200 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.651201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.652060 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:19.652063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.652749 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.652751 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:19.652821 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.653383 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:19.653390 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:19.655435 (+ 2045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:19.657481 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.657484 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.657485 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.657755 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.657983 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:19.657984 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:19.657984 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:19.658058 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:19.658348 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:19.658349 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:19.658404 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 01:03:19.658471 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 01:03:19.658592 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 01:03:19.658710 3756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:19.649636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52962 (local address 127.13.30.188:45027)
0811 01:03:19.649697 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:19.649700 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:19.649711 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:03:19.649761 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:19.649762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:19.649776 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:19.649850 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:19.650269 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.651095 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.652155 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:19.652627 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:19.652732 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:19.655551 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:19.655553 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:19.655553 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:19.655563 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:19.657325 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.657843 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.657845 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.657845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.657913 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:19.658119 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:19.658120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:19.658120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:19.658285 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:19.658349 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:19.658516 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 01:03:19.658612 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 01:03:19.661116 3640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4: Bootstrap starting.
I20260811 01:03:19.662002 3640 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:19.662343 3640 log.cc:824] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:19.663539 3640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4: No bootstrap required, opened a new log
I20260811 01:03:19.665715 3640 raft_consensus.cc:348] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } }
I20260811 01:03:19.665887 3640 raft_consensus.cc:374] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:19.665944 3640 raft_consensus.cc:729] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88e3adc873d476c865858cde44acff4, State: Initialized, Role: FOLLOWER
I20260811 01:03:19.666075 3640 consensus_queue.cc:260] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } }
I20260811 01:03:19.666402 3818 sys_catalog.cc:455] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } } }
I20260811 01:03:19.666561 3818 sys_catalog.cc:458] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:03:19.666471 3640 sys_catalog.cc:564] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 01:03:19.668614 3837 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:03:19.668744 3837 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:03:19.670838 3524 master_runner.cc:263] No leader master found from master b88e3adc873d476c865858cde44acff4
I20260811 01:03:19.670908 3524 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:03:19.735272 3761 raft_consensus.cc:482] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:03:19.735435 3761 raft_consensus.cc:504] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } }
I20260811 01:03:19.735711 3761 leader_election.cc:288] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b88e3adc873d476c865858cde44acff4 (127.13.30.189:37651), 01442d9b43fe4c5a990800a355293381 (127.13.30.188:45027)
I20260811 01:03:19.736116 3710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "df57c9f09fc542ecb3b8c777f5b00892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01442d9b43fe4c5a990800a355293381" is_pre_election: true
I20260811 01:03:19.736297 3710 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df57c9f09fc542ecb3b8c777f5b00892 in term 0.
I20260811 01:03:19.736498 3444 leader_election.cc:302] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01442d9b43fe4c5a990800a355293381, df57c9f09fc542ecb3b8c777f5b00892; no voters:
I20260811 01:03:19.736651 3761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:03:19.736701 3761 raft_consensus.cc:482] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:03:19.736729 3761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:19.737841 3602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "df57c9f09fc542ecb3b8c777f5b00892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88e3adc873d476c865858cde44acff4" is_pre_election: true
I20260811 01:03:19.738029 3602 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df57c9f09fc542ecb3b8c777f5b00892 in term 0.
I20260811 01:03:19.738750 3761 raft_consensus.cc:504] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } }
I20260811 01:03:19.738903 3761 leader_election.cc:288] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [CANDIDATE]: Term 1 election: Requested vote from peers b88e3adc873d476c865858cde44acff4 (127.13.30.189:37651), 01442d9b43fe4c5a990800a355293381 (127.13.30.188:45027)
I20260811 01:03:19.739187 3710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "df57c9f09fc542ecb3b8c777f5b00892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01442d9b43fe4c5a990800a355293381"
I20260811 01:03:19.739320 3710 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:19.740368 3710 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df57c9f09fc542ecb3b8c777f5b00892 in term 1.
I20260811 01:03:19.740578 3444 leader_election.cc:302] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01442d9b43fe4c5a990800a355293381, df57c9f09fc542ecb3b8c777f5b00892; no voters:
I20260811 01:03:19.740828 3602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "df57c9f09fc542ecb3b8c777f5b00892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b88e3adc873d476c865858cde44acff4"
I20260811 01:03:19.740927 3602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:19.741981 3602 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df57c9f09fc542ecb3b8c777f5b00892 in term 1.
I20260811 01:03:19.743360 3761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:03:19.743554 3761 raft_consensus.cc:686] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [term 1 LEADER]: Becoming Leader. State: Replica: df57c9f09fc542ecb3b8c777f5b00892, State: Running, Role: LEADER
I20260811 01:03:19.743667 3761 consensus_queue.cc:237] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } }
I20260811 01:03:19.744130 3761 sys_catalog.cc:455] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df57c9f09fc542ecb3b8c777f5b00892. Latest consensus state: current_term: 1 leader_uuid: "df57c9f09fc542ecb3b8c777f5b00892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } } }
I20260811 01:03:19.744217 3761 sys_catalog.cc:458] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:19.744468 3842 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:03:19.744673 3842 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:03:19.746961 3710 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [term 1 FOLLOWER]: Refusing update from remote peer df57c9f09fc542ecb3b8c777f5b00892: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:03:19.747306 3761 consensus_queue.cc:1035] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:03:19.748926 3793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df57c9f09fc542ecb3b8c777f5b00892. Latest consensus state: current_term: 1 leader_uuid: "df57c9f09fc542ecb3b8c777f5b00892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } } }
I20260811 01:03:19.749038 3793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:03:19.749507 3602 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [term 1 FOLLOWER]: Refusing update from remote peer df57c9f09fc542ecb3b8c777f5b00892: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:03:19.749833 3761 consensus_queue.cc:1035] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:03:19.751626 3818 sys_catalog.cc:455] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df57c9f09fc542ecb3b8c777f5b00892. Latest consensus state: current_term: 1 leader_uuid: "df57c9f09fc542ecb3b8c777f5b00892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } } }
I20260811 01:03:19.751741 3818 sys_catalog.cc:458] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 01:03:19.752072 3449 tablet.cc:2369] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:03:19.753208 3840 sys_catalog.cc:455] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "df57c9f09fc542ecb3b8c777f5b00892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } } }
I20260811 01:03:19.753312 3840 sys_catalog.cc:458] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:19.753752 3793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "df57c9f09fc542ecb3b8c777f5b00892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } } }
I20260811 01:03:19.753865 3793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:03:19.754185 3844 mvcc.cc:205] Tried to move back new op lower bound from 7317136178159898624 to 7317136178149928960. Current Snapshot: MvccSnapshot[applied={T|T < 7317136178159898624}]
I20260811 01:03:19.754806 3847 mvcc.cc:205] Tried to move back new op lower bound from 7317136178159898624 to 7317136178149928960. Current Snapshot: MvccSnapshot[applied={T|T < 7317136178159898624}]
I20260811 01:03:19.755448 3842 catalog_manager.cc:1347] Generated new cluster ID: a48b9a681c44442e81c6edc83dc6b025
I20260811 01:03:19.755507 3842 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:03:19.760000 3761 sys_catalog.cc:455] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "df57c9f09fc542ecb3b8c777f5b00892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } } }
I20260811 01:03:19.760133 3761 sys_catalog.cc:458] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892 [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:19.760982 3818 sys_catalog.cc:455] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "df57c9f09fc542ecb3b8c777f5b00892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df57c9f09fc542ecb3b8c777f5b00892" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36971 } } peers { permanent_uuid: "b88e3adc873d476c865858cde44acff4" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37651 } } peers { permanent_uuid: "01442d9b43fe4c5a990800a355293381" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45027 } } }
I20260811 01:03:19.761086 3818 sys_catalog.cc:458] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:03:19.788090 3842 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:03:19.788841 3842 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:03:19.797869 3842 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df57c9f09fc542ecb3b8c777f5b00892: Generated new TSK 0
I20260811 01:03:19.798142 3842 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:03:20.626876 3809 catalog_manager.cc:1259] Loaded cluster ID: a48b9a681c44442e81c6edc83dc6b025
I20260811 01:03:20.626959 3809 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381: loading cluster ID for follower catalog manager: success
I20260811 01:03:20.627766 3809 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381: acquiring CA information for follower catalog manager: success
I20260811 01:03:20.628074 3809 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 01442d9b43fe4c5a990800a355293381: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:03:20.669245 3837 catalog_manager.cc:1259] Loaded cluster ID: a48b9a681c44442e81c6edc83dc6b025
I20260811 01:03:20.669339 3837 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4: loading cluster ID for follower catalog manager: success
I20260811 01:03:20.670178 3837 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4: acquiring CA information for follower catalog manager: success
I20260811 01:03:20.670462 3837 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b88e3adc873d476c865858cde44acff4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:03:20.864627 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 3422
I20260811 01:03:20.884292 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 3524
I20260811 01:03:20.904016 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 3647
2026-08-11T01:03:20Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3087 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:03:20 dist-test-slave-42z9 krb5kdc[3866](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:03:20 dist-test-slave-42z9 krb5kdc[3866](info): set up 2 sockets
Aug 11 01:03:20 dist-test-slave-42z9 krb5kdc[3866](info): commencing operation
krb5kdc: starting...
W20260811 01:03:22.088022 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:03:22 dist-test-slave-42z9 krb5kdc[3866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:03:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:03:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:03:22.218302 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:34787
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:35851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:34787
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:22.303288 3899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:22.303542 3899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:22.303566 3899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:22.304838 3899 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:03:22.304898 3899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:22.304910 3899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:22.304924 3899 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:03:22.304934 3899 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:03:22.306602 3899 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:35851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:34787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:34787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:22.306854 3899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:22.307065 3899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:22.312307 3906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:22.312276 3912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:22.312347 3899 server_base.cc:1034] running on GCE node
W20260811 01:03:22.312282 3908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:22.312716 3899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:22.313023 3899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:22.314177 3899 hybrid_clock.cc:648] HybridClock initialized: now 1786410202314159 us; error 29 us; skew 500 ppm
Aug 11 01:03:22 dist-test-slave-42z9 krb5kdc[3866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410202, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:22.323810 3899 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:03:22.324339 3899 webserver.cc:460] Webserver started at http://127.13.30.190:42227/ using document root <none> and password file <none>
I20260811 01:03:22.324591 3899 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:22.324642 3899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:22.324779 3899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:03:22.325938 3899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "69231345936b4704b6c6743463045e67"
format_stamp: "Formatted at 2026-08-11 01:03:22 on dist-test-slave-42z9"
server_key: "bd88d593f9d2e907da3da9a3741451a1"
server_key_iv: "2aeef63bf3f0a664a7990f84ef0cfacb"
server_key_version: "encryptionkey@0"
I20260811 01:03:22.326270 3899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "69231345936b4704b6c6743463045e67"
format_stamp: "Formatted at 2026-08-11 01:03:22 on dist-test-slave-42z9"
server_key: "bd88d593f9d2e907da3da9a3741451a1"
server_key_iv: "2aeef63bf3f0a664a7990f84ef0cfacb"
server_key_version: "encryptionkey@0"
I20260811 01:03:22.327641 3899 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:03:22.328366 3920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:22.328523 3899 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:22.328613 3899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "69231345936b4704b6c6743463045e67"
format_stamp: "Formatted at 2026-08-11 01:03:22 on dist-test-slave-42z9"
server_key: "bd88d593f9d2e907da3da9a3741451a1"
server_key_iv: "2aeef63bf3f0a664a7990f84ef0cfacb"
server_key_version: "encryptionkey@0"
I20260811 01:03:22.328680 3899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:22.347673 3899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:22.349956 3899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:22.350111 3899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:22.354187 3899 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:34787
I20260811 01:03:22.354228 4011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:34787 every 8 connection(s)
I20260811 01:03:22.354588 3899 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:03:22.354771 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 3899
I20260811 01:03:22.354874 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:03:22.355090 13434 external_mini_cluster.cc:1428] Setting key 97a2ffb9d3f8c32df01783895e3e7b8b
I20260811 01:03:22.355592 4014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:22.358306 4014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67: Bootstrap starting.
I20260811 01:03:22.358919 4014 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:22.359207 4014 log.cc:824] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:22.360025 4014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67: No bootstrap required, opened a new log
Aug 11 01:03:22 dist-test-slave-42z9 krb5kdc[3866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:22.361979 4014 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69231345936b4704b6c6743463045e67" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34787 } }
I20260811 01:03:22.362165 4014 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:22.362246 4014 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69231345936b4704b6c6743463045e67, State: Initialized, Role: FOLLOWER
I20260811 01:03:22.362401 4014 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69231345936b4704b6c6743463045e67" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34787 } }
I20260811 01:03:22.362483 4014 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:03:22.362509 4014 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:03:22.362555 4014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:22.363224 4014 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69231345936b4704b6c6743463045e67" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34787 } }
I20260811 01:03:22.363317 4014 leader_election.cc:302] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69231345936b4704b6c6743463045e67; no voters:
I20260811 01:03:22.363498 4014 leader_election.cc:288] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:03:22.363557 4023 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:03:22.363770 4023 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [term 1 LEADER]: Becoming Leader. State: Replica: 69231345936b4704b6c6743463045e67, State: Running, Role: LEADER
I20260811 01:03:22.363785 4014 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:03:22.363898 4023 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69231345936b4704b6c6743463045e67" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34787 } }
I20260811 01:03:22.364369 4028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69231345936b4704b6c6743463045e67. Latest consensus state: current_term: 1 leader_uuid: "69231345936b4704b6c6743463045e67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69231345936b4704b6c6743463045e67" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34787 } } }
I20260811 01:03:22.364521 4028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:22.364908 4026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69231345936b4704b6c6743463045e67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69231345936b4704b6c6743463045e67" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34787 } } }
I20260811 01:03:22.365031 4048 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:03:22.365052 4026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67 [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:22.365464 4021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:22.355611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34976 (local address 127.13.30.190:34787)
0811 01:03:22.355783 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:22.355791 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:22.355817 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:03:22.356272 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:22.356279 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:22.356326 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:22.356451 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:22.357091 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:22.358033 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:22.358799 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:22.359228 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:22.359345 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:22.361773 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:22.361778 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:22.361779 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:22.361791 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:22.363591 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:22.364004 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:22.364008 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:22.364008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:22.364102 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:22.364320 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:22.364321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:22.364321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:22.364655 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:22.364781 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:22.365067 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 01:03:22.365225 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":86,"threads_started":1}
I20260811 01:03:22.365651 4048 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:03:22.367043 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:03:22.367270 4048 catalog_manager.cc:1347] Generated new cluster ID: 995bb64355854d45b35c80812352d473
I20260811 01:03:22.367318 4048 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:03:22.384984 4048 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:03:22.385838 4048 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:03:22.394271 4048 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69231345936b4704b6c6743463045e67: Generated new TSK 0
I20260811 01:03:22.394523 4048 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:03:22.421190 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 3899
2026-08-11T01:03:22Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1520 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:03:22 dist-test-slave-42z9 krb5kdc[4061](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:03:22 dist-test-slave-42z9 krb5kdc[4061](info): set up 2 sockets
Aug 11 01:03:22 dist-test-slave-42z9 krb5kdc[4061](info): commencing operation
krb5kdc: starting...
W20260811 01:03:23.599005 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:03:23 dist-test-slave-42z9 krb5kdc[4061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410203, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:03:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:03:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:03:23.732072 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:37451
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:45167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:37451
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:23.818619 4081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:23.818862 4081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:23.818899 4081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:23.820158 4081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:03:23.820204 4081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:23.820225 4081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:23.820240 4081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:03:23.820256 4081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:03:23.821923 4081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:45167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:37451
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:37451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:23.822198 4081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:23.822439 4081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:23.827540 4092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:23.827698 4095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:23.827754 4090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:23.827880 4081 server_base.cc:1034] running on GCE node
I20260811 01:03:23.828207 4081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:23.828542 4081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:23.829696 4081 hybrid_clock.cc:648] HybridClock initialized: now 1786410203829683 us; error 33 us; skew 500 ppm
Aug 11 01:03:23 dist-test-slave-42z9 krb5kdc[4061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410203, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:23.832301 4081 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:03:23.832789 4081 webserver.cc:460] Webserver started at http://127.13.30.190:46343/ using document root <none> and password file <none>
I20260811 01:03:23.833019 4081 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:23.833071 4081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:23.833206 4081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:03:23.834378 4081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "c77d5dccc0164cdd8f491343268094a2"
format_stamp: "Formatted at 2026-08-11 01:03:23 on dist-test-slave-42z9"
server_key: "bd6f374d12cafc667c28538dee0bfdaf"
server_key_iv: "baf134f7bd451a84624171b1e4df272b"
server_key_version: "encryptionkey@0"
I20260811 01:03:23.834739 4081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "c77d5dccc0164cdd8f491343268094a2"
format_stamp: "Formatted at 2026-08-11 01:03:23 on dist-test-slave-42z9"
server_key: "bd6f374d12cafc667c28538dee0bfdaf"
server_key_iv: "baf134f7bd451a84624171b1e4df272b"
server_key_version: "encryptionkey@0"
I20260811 01:03:23.836117 4081 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:03:23.836822 4107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:23.836992 4081 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:23.837081 4081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "c77d5dccc0164cdd8f491343268094a2"
format_stamp: "Formatted at 2026-08-11 01:03:23 on dist-test-slave-42z9"
server_key: "bd6f374d12cafc667c28538dee0bfdaf"
server_key_iv: "baf134f7bd451a84624171b1e4df272b"
server_key_version: "encryptionkey@0"
I20260811 01:03:23.837154 4081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:23.843696 4081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:23.845619 4081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:23.845781 4081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:23.850044 4081 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:37451
I20260811 01:03:23.850085 4190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:37451 every 8 connection(s)
I20260811 01:03:23.850443 4081 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:03:23.851483 4191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:23.853932 4191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Bootstrap starting.
I20260811 01:03:23.854506 4191 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:23.854755 4191 log.cc:824] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:23.855454 4191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: No bootstrap required, opened a new log
I20260811 01:03:23.857085 4191 raft_consensus.cc:348] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } }
I20260811 01:03:23.857242 4191 raft_consensus.cc:374] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:23.857265 4191 raft_consensus.cc:729] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c77d5dccc0164cdd8f491343268094a2, State: Initialized, Role: FOLLOWER
I20260811 01:03:23.857385 4191 consensus_queue.cc:260] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } }
I20260811 01:03:23.857493 4191 raft_consensus.cc:388] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:03:23.857530 4191 raft_consensus.cc:482] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:03:23.857560 4191 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:23.858450 4191 raft_consensus.cc:504] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } }
I20260811 01:03:23.858546 4191 leader_election.cc:302] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c77d5dccc0164cdd8f491343268094a2; no voters:
I20260811 01:03:23.858579 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 4081
I20260811 01:03:23.858681 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:03:23.858711 4191 leader_election.cc:288] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:03:23.858738 4195 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:03:23.858881 13434 external_mini_cluster.cc:1428] Setting key 97451d6738e0d64c560279a7c421d785
I20260811 01:03:23.858914 4195 raft_consensus.cc:686] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 1 LEADER]: Becoming Leader. State: Replica: c77d5dccc0164cdd8f491343268094a2, State: Running, Role: LEADER
I20260811 01:03:23.858999 4195 consensus_queue.cc:237] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } }
I20260811 01:03:23.859093 4191 sys_catalog.cc:564] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:03:23.859452 4197 sys_catalog.cc:455] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c77d5dccc0164cdd8f491343268094a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } } }
I20260811 01:03:23.859650 4197 sys_catalog.cc:458] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:23.859587 4198 sys_catalog.cc:455] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c77d5dccc0164cdd8f491343268094a2. Latest consensus state: current_term: 1 leader_uuid: "c77d5dccc0164cdd8f491343268094a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } } }
I20260811 01:03:23.859848 4198 sys_catalog.cc:458] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:23.860370 4211 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:03:23.861073 4211 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:03:23.863106 4211 catalog_manager.cc:1347] Generated new cluster ID: 0309070e9efb4dee8bee122860458981
I20260811 01:03:23.863175 4211 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 01:03:23 dist-test-slave-42z9 krb5kdc[4061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410203, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:23.871392 4201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:23.859380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33162 (local address 127.13.30.190:37451)
0811 01:03:23.859557 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:23.859566 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:23.859801 (+ 235us) server_negotiation.cc:407] Connection header received
0811 01:03:23.859963 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:23.859971 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:23.860035 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:23.860162 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:23.860993 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:23.862609 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:23.863755 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:23.864400 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:23.864545 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:23.867467 (+ 2922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:23.867473 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:23.867473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:23.867489 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:23.869502 (+ 2013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:23.869962 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:23.869965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:23.869965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:23.870087 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:23.870286 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:23.870286 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:23.870286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:23.870603 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:23.870752 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:23.870881 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 01:03:23.871131 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":71,"threads_started":1}
I20260811 01:03:23.881659 4211 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:03:23.882218 4211 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:03:23.894158 4211 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Generated new TSK 0
I20260811 01:03:23.894375 4211 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:03:23.927866 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37451
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:45167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:24.016872 4228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:24.017120 4228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:24.017148 4228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:24.018486 4228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:24.018548 4228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:24.018579 4228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:03:24.020357 4228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:45167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:24.020661 4228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:24.020922 4228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:24.026264 4241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:24.026248 4238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:24.026250 4244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:24.026501 4228 server_base.cc:1034] running on GCE node
I20260811 01:03:24.026718 4228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:24.026990 4228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:24.028144 4228 hybrid_clock.cc:648] HybridClock initialized: now 1786410204028128 us; error 33 us; skew 500 ppm
Aug 11 01:03:24 dist-test-slave-42z9 krb5kdc[4061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410204, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:24.031064 4228 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:03:24.031558 4228 webserver.cc:460] Webserver started at http://127.13.30.129:33425/ using document root <none> and password file <none>
I20260811 01:03:24.031814 4228 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:24.031868 4228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:24.032025 4228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:03:24.033192 4228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "0f9052fd928247fda8cc62614496bbcb"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "62b75673b9ae7df65767898e68340caf"
server_key_iv: "3d96a7a769a442fae5971c2febed675e"
server_key_version: "encryptionkey@0"
I20260811 01:03:24.033572 4228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "0f9052fd928247fda8cc62614496bbcb"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "62b75673b9ae7df65767898e68340caf"
server_key_iv: "3d96a7a769a442fae5971c2febed675e"
server_key_version: "encryptionkey@0"
I20260811 01:03:24.035066 4228 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:03:24.035887 4255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:24.036084 4228 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:03:24.036192 4228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "0f9052fd928247fda8cc62614496bbcb"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "62b75673b9ae7df65767898e68340caf"
server_key_iv: "3d96a7a769a442fae5971c2febed675e"
server_key_version: "encryptionkey@0"
I20260811 01:03:24.036262 4228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:24.066860 4228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:24.068773 4228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:24.068938 4228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:24.069185 4228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:24.069552 4228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:24.069594 4228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:24.069626 4228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:24.069650 4228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:24.075421 4228 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:39921
I20260811 01:03:24.075490 4438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:39921 every 8 connection(s)
I20260811 01:03:24.075781 4228 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
Aug 11 01:03:24 dist-test-slave-42z9 krb5kdc[4061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410204, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:24.084546 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 4228
I20260811 01:03:24.084668 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:03:24.084910 13434 external_mini_cluster.cc:1428] Setting key 489d7c59938457dc7d4da3a4421e2685
I20260811 01:03:24.085819 4201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.076496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:55109 (local address 127.13.30.190:37451)
0811 01:03:24.076547 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:24.076549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:24.076752 (+ 203us) server_negotiation.cc:407] Connection header received
0811 01:03:24.077282 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:24.077283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:24.077297 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:24.077341 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:24.078402 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.078926 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.079944 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.080139 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.080187 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.082684 (+ 2497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:24.082686 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:24.082686 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:24.082695 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:24.084080 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:24.084567 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:24.084569 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:24.084569 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:24.084646 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:24.084994 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:24.084995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:24.084995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:24.085166 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:24.085243 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:24.085603 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 01:03:24.085727 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 01:03:24.086048 4443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.076463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:55109)
0811 01:03:24.076629 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:24.076672 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:24.077173 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:24.077404 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:24.077408 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:24.078067 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:24.078277 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.078282 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.079002 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.079003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.079869 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.079872 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.080199 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.080200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.080337 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.080857 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:24.080867 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:24.082573 (+ 1706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:24.084191 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:24.084202 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:24.084204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:24.084476 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:24.084740 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:24.084741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:24.084742 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:24.084903 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:24.085245 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:24.085253 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:24.085423 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 01:03:24.085572 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 01:03:24.085778 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":75,"threads_started":1}
I20260811 01:03:24.086695 4439 heartbeater.cc:347] Connected to a master server at 127.13.30.190:37451
I20260811 01:03:24.086809 4439 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:24.087013 4439 heartbeater.cc:511] Master 127.13.30.190:37451 requested a full tablet report, sending...
I20260811 01:03:24.087553 4132 ts_manager.cc:194] Registered new tserver with Master: 0f9052fd928247fda8cc62614496bbcb (127.13.30.129:39921)
I20260811 01:03:24.088251 4132 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:55109
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:03:24.113660 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37451
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:45167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:24.201336 4446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:24.201603 4446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:24.201629 4446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:24.202832 4446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:24.202876 4446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:24.202903 4446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:03:24.204450 4446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:45167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:24.204703 4446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:24.204923 4446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:24.210556 4456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:24.210568 4458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:24.210563 4454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:24.210685 4446 server_base.cc:1034] running on GCE node
I20260811 01:03:24.211228 4446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:24.211583 4446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:24.212823 4446 hybrid_clock.cc:648] HybridClock initialized: now 1786410204212804 us; error 29 us; skew 500 ppm
Aug 11 01:03:24 dist-test-slave-42z9 krb5kdc[4061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410204, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:24.215869 4446 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:03:24.216435 4446 webserver.cc:460] Webserver started at http://127.13.30.130:43591/ using document root <none> and password file <none>
I20260811 01:03:24.216681 4446 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:24.216735 4446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:24.216872 4446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:03:24.218102 4446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "c7a18fa8210e47d198536a3491469e59"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "d6ffe8b6ac0176b182fdf148c90f8052"
server_key_iv: "562748e695a9eb26e86bc4808cf07902"
server_key_version: "encryptionkey@0"
I20260811 01:03:24.218454 4446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "c7a18fa8210e47d198536a3491469e59"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "d6ffe8b6ac0176b182fdf148c90f8052"
server_key_iv: "562748e695a9eb26e86bc4808cf07902"
server_key_version: "encryptionkey@0"
I20260811 01:03:24.219882 4446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:03:24.220626 4469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:24.220779 4446 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:24.220870 4446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "c7a18fa8210e47d198536a3491469e59"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "d6ffe8b6ac0176b182fdf148c90f8052"
server_key_iv: "562748e695a9eb26e86bc4808cf07902"
server_key_version: "encryptionkey@0"
I20260811 01:03:24.220947 4446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:24.234187 4446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:24.236439 4446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:24.236593 4446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:24.236822 4446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:24.237147 4446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:24.237182 4446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:24.237213 4446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:24.237236 4446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:24.243396 4446 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:46097
I20260811 01:03:24.243450 4639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:46097 every 8 connection(s)
I20260811 01:03:24.243778 4446 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
Aug 11 01:03:24 dist-test-slave-42z9 krb5kdc[4061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410204, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:24.250633 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 4446
I20260811 01:03:24.250737 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:03:24.250936 13434 external_mini_cluster.cc:1428] Setting key fcd5c29c862b5c9ba8d7db62e325aa78
I20260811 01:03:24.253490 4201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.244531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:59807 (local address 127.13.30.190:37451)
0811 01:03:24.244594 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:24.244596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:24.244793 (+ 197us) server_negotiation.cc:407] Connection header received
0811 01:03:24.245363 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:24.245364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:24.245378 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:24.245429 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:24.246496 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.247014 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.248041 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.248243 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.248311 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.250608 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:24.250609 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:24.250610 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:24.250618 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:24.252070 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:24.252498 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:24.252499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:24.252500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:24.252562 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:24.252790 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:24.252791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:24.252791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:24.252916 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:24.252976 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:24.253253 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 01:03:24.253370 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 01:03:24.253676 4645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.244502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:59807)
0811 01:03:24.244666 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:24.244706 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:24.245242 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:24.245543 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:24.245547 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:24.246164 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:24.246386 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.246392 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.247110 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.247111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.247945 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.247948 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.248324 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.248325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.248462 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.248983 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:24.248992 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:24.250504 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:24.252161 (+ 1657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:24.252170 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:24.252172 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:24.252428 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:24.252619 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:24.252620 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:24.252620 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:24.252734 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:24.252973 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:24.252981 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:24.253131 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 01:03:24.253224 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 01:03:24.253405 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":71,"threads_started":1}
I20260811 01:03:24.254251 4640 heartbeater.cc:347] Connected to a master server at 127.13.30.190:37451
I20260811 01:03:24.254365 4640 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:24.254570 4640 heartbeater.cc:511] Master 127.13.30.190:37451 requested a full tablet report, sending...
I20260811 01:03:24.254987 4132 ts_manager.cc:194] Registered new tserver with Master: c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097)
I20260811 01:03:24.255368 4132 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:59807
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:03:24.278465 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37451
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:45167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:24.364771 4649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:24.364995 4649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:24.365031 4649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:24.366302 4649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:24.366349 4649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:24.366387 4649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:03:24.367952 4649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:45167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:24.368219 4649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:24.368463 4649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:24.373725 4657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:24.373747 4654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:24.373754 4649 server_base.cc:1034] running on GCE node
W20260811 01:03:24.373725 4655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:24.374148 4649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:24.374396 4649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:24.375564 4649 hybrid_clock.cc:648] HybridClock initialized: now 1786410204375561 us; error 45 us; skew 500 ppm
Aug 11 01:03:24 dist-test-slave-42z9 krb5kdc[4061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410204, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:24.378228 4649 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:03:24.378705 4649 webserver.cc:460] Webserver started at http://127.13.30.131:43345/ using document root <none> and password file <none>
I20260811 01:03:24.378944 4649 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:24.378993 4649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:24.379127 4649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:03:24.380280 4649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "4117417a80d94c19bf52659b2d9c22bd"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "13633b2623cc2c8a12b752fd9a246d78"
server_key_iv: "c0778c8095b8ce2744a8ab1160aa997a"
server_key_version: "encryptionkey@0"
I20260811 01:03:24.380636 4649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "4117417a80d94c19bf52659b2d9c22bd"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "13633b2623cc2c8a12b752fd9a246d78"
server_key_iv: "c0778c8095b8ce2744a8ab1160aa997a"
server_key_version: "encryptionkey@0"
I20260811 01:03:24.382053 4649 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 01:03:24.382772 4673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:24.382934 4649 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:24.383021 4649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "4117417a80d94c19bf52659b2d9c22bd"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "13633b2623cc2c8a12b752fd9a246d78"
server_key_iv: "c0778c8095b8ce2744a8ab1160aa997a"
server_key_version: "encryptionkey@0"
I20260811 01:03:24.383095 4649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:24.442452 4649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:24.444716 4649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:24.444864 4649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:24.445112 4649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:24.445396 4649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:24.445427 4649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:24.445477 4649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:24.445506 4649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:24.451457 4649 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:43917
I20260811 01:03:24.451515 4851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:43917 every 8 connection(s)
I20260811 01:03:24.451848 4649 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:03:24.455271 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 4649
I20260811 01:03:24.455379 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:03:24.455564 13434 external_mini_cluster.cc:1428] Setting key 3949110c09e606a0389d78d7b00e4752
Aug 11 01:03:24 dist-test-slave-42z9 krb5kdc[4061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410204, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:24.461659 4201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.452604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:35533 (local address 127.13.30.190:37451)
0811 01:03:24.452666 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:24.452668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:24.452835 (+ 167us) server_negotiation.cc:407] Connection header received
0811 01:03:24.453331 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:24.453332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:24.453342 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:24.453406 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:24.454461 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.454975 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.456412 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.456612 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.456669 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.459005 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:24.459007 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:24.459007 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:24.459016 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:24.460277 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:24.460681 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:24.460682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:24.460683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:24.460744 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:24.460972 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:24.460973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:24.460973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:24.461105 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:24.461162 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:24.461467 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 01:03:24.461559 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 01:03:24.461870 4859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.452549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:35533)
0811 01:03:24.452712 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:24.452757 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:24.453255 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:24.453500 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:24.453504 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:24.454096 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:24.454320 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.454325 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.455078 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.455079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.456284 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.456287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.456691 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.456692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.456828 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.457348 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:24.457356 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:24.458871 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:24.460352 (+ 1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:24.460361 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:24.460364 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:24.460610 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:24.460801 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:24.460802 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:24.460803 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:24.460916 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:24.461163 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:24.461171 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:24.461317 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 01:03:24.461412 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 01:03:24.461634 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":85,"threads_started":1}
I20260811 01:03:24.462374 4852 heartbeater.cc:347] Connected to a master server at 127.13.30.190:37451
I20260811 01:03:24.462483 4852 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:24.462658 4852 heartbeater.cc:511] Master 127.13.30.190:37451 requested a full tablet report, sending...
I20260811 01:03:24.463006 4132 ts_manager.cc:194] Registered new tserver with Master: 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917)
I20260811 01:03:24.463356 4132 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:35533
I20260811 01:03:24.467263 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:03:24.474098 4201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.468621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33174 (local address 127.13.30.190:37451)
0811 01:03:24.468691 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:24.468694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:24.468772 (+ 78us) server_negotiation.cc:407] Connection header received
0811 01:03:24.468820 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:24.468821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:24.468830 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:24.468877 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:24.469407 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.469923 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.470627 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.470803 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.470845 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.471939 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:24.471940 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:24.471940 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:24.471947 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:24.473083 (+ 1136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:24.473419 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:24.473419 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:24.473420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:24.473506 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:24.473656 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:24.473656 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:24.473656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:24.473804 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:24.473881 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:24.473959 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 01:03:24.474027 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 01:03:24.475665 4132 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33174:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:03:24.477597 4132 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:03:24.484223 4879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.480396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37916 (local address 127.13.30.129:39921)
0811 01:03:24.480596 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:24.480600 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:24.480610 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:03:24.480645 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:24.480647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:24.480661 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:24.480729 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:24.480863 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.482021 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.483289 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.483813 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.483878 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.483943 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:24.484089 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 01:03:24.484133 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":100,"threads_started":1}
I20260811 01:03:24.484221 4878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.480177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:39921 (local address 127.0.0.1:37916)
0811 01:03:24.480302 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:24.480313 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:24.480370 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:24.480751 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:24.480752 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:24.480754 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:24.480784 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.480785 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.482136 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.482137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.483225 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.483227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.483892 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.483893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.483981 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.483996 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 01:03:24.484063 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 01:03:24.484120 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":2,"thread_start_us":74,"threads_started":1}
I20260811 01:03:24.484421 4875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.480086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42780 (local address 127.13.30.131:43917)
0811 01:03:24.480414 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:24.480419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:24.480429 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:03:24.480462 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:24.480464 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:24.480477 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:24.480540 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:24.480952 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.481746 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.483221 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.483903 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.483966 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.484029 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:24.484289 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 01:03:24.484332 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":88,"threads_started":1}
I20260811 01:03:24.484421 4877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.480119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43666 (local address 127.13.30.130:46097)
0811 01:03:24.480513 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:24.480518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:24.480528 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:03:24.480570 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:24.480572 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:24.480587 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:24.480661 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:24.480841 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.482050 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.483155 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.483895 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.483966 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.484024 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:24.484289 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 01:03:24.484337 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":87,"threads_started":1}
I20260811 01:03:24.484477 4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.479999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:46097 (local address 127.0.0.1:43666)
0811 01:03:24.480257 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:24.480267 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:24.480306 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:24.480671 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:24.480672 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:24.480675 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:24.480758 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.480760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.482154 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.482155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.483074 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.483077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.484064 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.484065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.484136 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.484142 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 01:03:24.484189 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 01:03:24.484241 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":39,"thread_start_us":92,"threads_started":1}
I20260811 01:03:24.484570 4872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.479970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:43917 (local address 127.0.0.1:42780)
0811 01:03:24.480170 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:24.480212 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:24.480285 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:24.480624 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:24.480627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:24.480629 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:24.480859 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.480862 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.481839 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.481841 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.483147 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.483150 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.484062 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.484064 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.484136 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.484143 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 01:03:24.484189 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:03:24.484241 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":42,"thread_start_us":63,"threads_started":1}
I20260811 01:03:24.485278 4541 tablet_service.cc:1467] Processing CreateTablet for tablet 4c6df5a87f2e4020bbdf5b1337e615c1 (DEFAULT_TABLE table=test-table [id=4cf8fb1b1b004e528902e0e67c64674a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:03:24.485324 4747 tablet_service.cc:1467] Processing CreateTablet for tablet 4c6df5a87f2e4020bbdf5b1337e615c1 (DEFAULT_TABLE table=test-table [id=4cf8fb1b1b004e528902e0e67c64674a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:03:24.485375 4331 tablet_service.cc:1467] Processing CreateTablet for tablet 4c6df5a87f2e4020bbdf5b1337e615c1 (DEFAULT_TABLE table=test-table [id=4cf8fb1b1b004e528902e0e67c64674a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:03:24.485729 4747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c6df5a87f2e4020bbdf5b1337e615c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:24.485726 4541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c6df5a87f2e4020bbdf5b1337e615c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:24.485843 4331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c6df5a87f2e4020bbdf5b1337e615c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:24.488515 4881 tablet_bootstrap.cc:492] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59: Bootstrap starting.
I20260811 01:03:24.489256 4881 tablet_bootstrap.cc:654] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:24.489427 4882 tablet_bootstrap.cc:492] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Bootstrap starting.
I20260811 01:03:24.490031 4881 log.cc:824] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:24.490159 4882 tablet_bootstrap.cc:654] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:24.490698 4882 log.cc:824] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:24.491047 4883 tablet_bootstrap.cc:492] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd: Bootstrap starting.
I20260811 01:03:24.491355 4881 tablet_bootstrap.cc:492] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59: No bootstrap required, opened a new log
I20260811 01:03:24.491461 4881 ts_tablet_manager.cc:1397] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 01:03:24.491540 4882 tablet_bootstrap.cc:492] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: No bootstrap required, opened a new log
I20260811 01:03:24.491675 4882 ts_tablet_manager.cc:1397] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 01:03:24.491920 4883 tablet_bootstrap.cc:654] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:24.492558 4883 log.cc:824] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:24.493728 4883 tablet_bootstrap.cc:492] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd: No bootstrap required, opened a new log
I20260811 01:03:24.493814 4883 ts_tablet_manager.cc:1397] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 01:03:24.493743 4882 raft_consensus.cc:348] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } }
I20260811 01:03:24.493925 4882 raft_consensus.cc:374] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:24.494006 4882 raft_consensus.cc:729] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f9052fd928247fda8cc62614496bbcb, State: Initialized, Role: FOLLOWER
I20260811 01:03:24.494153 4882 consensus_queue.cc:260] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } }
I20260811 01:03:24.494122 4881 raft_consensus.cc:348] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } }
I20260811 01:03:24.494342 4881 raft_consensus.cc:374] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:24.494397 4881 raft_consensus.cc:729] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7a18fa8210e47d198536a3491469e59, State: Initialized, Role: FOLLOWER
I20260811 01:03:24.494463 4882 ts_tablet_manager.cc:1428] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 01:03:24.494526 4881 consensus_queue.cc:260] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } }
I20260811 01:03:24.494666 4439 heartbeater.cc:503] Master 127.13.30.190:37451 was elected leader, sending a full tablet report...
I20260811 01:03:24.494854 4881 ts_tablet_manager.cc:1428] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:03:24.494891 4640 heartbeater.cc:503] Master 127.13.30.190:37451 was elected leader, sending a full tablet report...
I20260811 01:03:24.495801 4883 raft_consensus.cc:348] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } }
I20260811 01:03:24.495942 4883 raft_consensus.cc:374] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:24.495987 4883 raft_consensus.cc:729] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4117417a80d94c19bf52659b2d9c22bd, State: Initialized, Role: FOLLOWER
I20260811 01:03:24.496090 4883 consensus_queue.cc:260] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } }
I20260811 01:03:24.496368 4883 ts_tablet_manager.cc:1428] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:03:24.496412 4852 heartbeater.cc:503] Master 127.13.30.190:37451 was elected leader, sending a full tablet report...
W20260811 01:03:24.576475 4441 tablet.cc:2369] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:03:24.674815 4894 raft_consensus.cc:482] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:03:24.674974 4894 raft_consensus.cc:504] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } }
I20260811 01:03:24.675410 4894 leader_election.cc:288] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f9052fd928247fda8cc62614496bbcb (127.13.30.129:39921), c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097)
I20260811 01:03:24.678494 4877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.675741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:51741 (local address 127.13.30.130:46097)
0811 01:03:24.675790 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:24.675791 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:24.675802 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:03:24.675831 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:24.675832 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:24.675841 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:24.675913 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:24.676095 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.676645 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.677703 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.678130 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.678189 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.678198 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:24.678374 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 01:03:24.678419 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 01:03:24.678503 4879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.675702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:50835 (local address 127.13.30.129:39921)
0811 01:03:24.675777 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:24.675779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:24.676049 (+ 270us) server_negotiation.cc:407] Connection header received
0811 01:03:24.676080 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:24.676082 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:24.676096 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:24.676144 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:24.676313 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.676828 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.677810 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.678179 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.678253 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.678261 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:24.678393 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 01:03:24.678432 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 01:03:24.678534 4895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.675627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:39921 (local address 127.13.30.131:50835)
0811 01:03:24.675949 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:24.675966 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:24.676014 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:24.676169 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:24.676170 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:24.676171 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:24.676247 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.676249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.676911 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.676911 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.677718 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.677721 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.678267 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.678268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.678324 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.678327 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:03:24.678379 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 01:03:24.678419 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":150,"thread_start_us":109,"threads_started":1}
I20260811 01:03:24.678542 4859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.675627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:46097 (local address 127.13.30.131:51741)
0811 01:03:24.675673 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:24.675685 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:24.675729 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:24.675935 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:24.675937 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:24.675939 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:24.676018 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.676020 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.676734 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.676735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.677616 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:24.677619 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.678212 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.678213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:24.678299 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.678304 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:03:24.678350 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:03:24.678400 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":4}
I20260811 01:03:24.678905 4368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6df5a87f2e4020bbdf5b1337e615c1" candidate_uuid: "4117417a80d94c19bf52659b2d9c22bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f9052fd928247fda8cc62614496bbcb" is_pre_election: true
I20260811 01:03:24.678905 4569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6df5a87f2e4020bbdf5b1337e615c1" candidate_uuid: "4117417a80d94c19bf52659b2d9c22bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a18fa8210e47d198536a3491469e59" is_pre_election: true
I20260811 01:03:24.679097 4368 raft_consensus.cc:2454] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4117417a80d94c19bf52659b2d9c22bd in term 0.
I20260811 01:03:24.679097 4569 raft_consensus.cc:2454] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4117417a80d94c19bf52659b2d9c22bd in term 0.
I20260811 01:03:24.679365 4678 leader_election.cc:302] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f9052fd928247fda8cc62614496bbcb, 4117417a80d94c19bf52659b2d9c22bd; no voters:
I20260811 01:03:24.679517 4894 raft_consensus.cc:2781] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:03:24.679586 4894 raft_consensus.cc:482] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:03:24.679605 4894 raft_consensus.cc:3037] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:24.680392 4894 raft_consensus.cc:504] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } }
I20260811 01:03:24.680534 4894 leader_election.cc:288] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [CANDIDATE]: Term 1 election: Requested vote from peers 0f9052fd928247fda8cc62614496bbcb (127.13.30.129:39921), c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097)
I20260811 01:03:24.680711 4569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6df5a87f2e4020bbdf5b1337e615c1" candidate_uuid: "4117417a80d94c19bf52659b2d9c22bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a18fa8210e47d198536a3491469e59"
I20260811 01:03:24.680727 4368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c6df5a87f2e4020bbdf5b1337e615c1" candidate_uuid: "4117417a80d94c19bf52659b2d9c22bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f9052fd928247fda8cc62614496bbcb"
I20260811 01:03:24.680792 4569 raft_consensus.cc:3037] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:24.680816 4368 raft_consensus.cc:3037] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:24.681628 4569 raft_consensus.cc:2454] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4117417a80d94c19bf52659b2d9c22bd in term 1.
I20260811 01:03:24.681643 4368 raft_consensus.cc:2454] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4117417a80d94c19bf52659b2d9c22bd in term 1.
I20260811 01:03:24.681802 4678 leader_election.cc:302] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f9052fd928247fda8cc62614496bbcb, 4117417a80d94c19bf52659b2d9c22bd; no voters:
I20260811 01:03:24.681914 4894 raft_consensus.cc:2781] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:03:24.682087 4894 raft_consensus.cc:686] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [term 1 LEADER]: Becoming Leader. State: Replica: 4117417a80d94c19bf52659b2d9c22bd, State: Running, Role: LEADER
I20260811 01:03:24.682193 4894 consensus_queue.cc:237] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } }
I20260811 01:03:24.683096 4130 catalog_manager.cc:5495] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131). New cstate: current_term: 1 leader_uuid: "4117417a80d94c19bf52659b2d9c22bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } health_report { overall_health: UNKNOWN } } }
W20260811 01:03:24.702441 4853 tablet.cc:2369] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:03:24.714148 4875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.711915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42784 (local address 127.13.30.131:43917)
0811 01:03:24.712006 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:24.712008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:24.712016 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:03:24.712054 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:24.712055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:24.712072 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:24.712133 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:03:24.712237 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.712734 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.713479 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:24.713672 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:24.713717 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:24.713837 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:03:24.713945 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:03:24.714006 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:24.714020 (+ 14us) server_negotiation.cc:299] Negotiation successful
0811 01:03:24.714040 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:03:24.716050 4368 raft_consensus.cc:1261] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Refusing update from remote peer 4117417a80d94c19bf52659b2d9c22bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:03:24.716054 4569 raft_consensus.cc:1261] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59 [term 1 FOLLOWER]: Refusing update from remote peer 4117417a80d94c19bf52659b2d9c22bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:03:24.716415 4894 consensus_queue.cc:1035] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:03:24.716579 4896 consensus_queue.cc:1035] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:03:24.718896 4899 mvcc.cc:205] Tried to move back new op lower bound from 7317136198514069504 to 7317136198379016192. Current Snapshot: MvccSnapshot[applied={T|T < 7317136198514069504}]
I20260811 01:03:24.719472 4903 mvcc.cc:205] Tried to move back new op lower bound from 7317136198514069504 to 7317136198379016192. Current Snapshot: MvccSnapshot[applied={T|T < 7317136198514069504 or (T in {7317136198514069504})}]
I20260811 01:03:24.722057 4130 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:03:24.722158 4130 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:03:24.722925 4130 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Sending DeleteTablet for 3 replicas of tablet 4c6df5a87f2e4020bbdf5b1337e615c1
I20260811 01:03:24.723304 4541 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c6df5a87f2e4020bbdf5b1337e615c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:03:24 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:43666
I20260811 01:03:24.723395 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 4228
I20260811 01:03:24.723400 4331 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c6df5a87f2e4020bbdf5b1337e615c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:03:24 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:37916
I20260811 01:03:24.723524 4747 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c6df5a87f2e4020bbdf5b1337e615c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:03:24 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:42780
I20260811 01:03:24.737629 4915 tablet_replica.cc:330] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59: stopping tablet replica
I20260811 01:03:24.737900 4915 raft_consensus.cc:2229] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:03:24.738142 4915 raft_consensus.cc:2258] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:03:24.738525 4917 tablet_replica.cc:330] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd: stopping tablet replica
I20260811 01:03:24.738651 4917 raft_consensus.cc:2229] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:03:24.738790 4917 raft_consensus.cc:2258] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:03:24.739171 4915 ts_tablet_manager.cc:1905] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:03:24.741039 4915 ts_tablet_manager.cc:1918] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:03:24.741125 4915 log.cc:1196] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/4c6df5a87f2e4020bbdf5b1337e615c1
I20260811 01:03:24.741351 4915 ts_tablet_manager.cc:1939] T 4c6df5a87f2e4020bbdf5b1337e615c1 P c7a18fa8210e47d198536a3491469e59: Deleting consensus metadata
I20260811 01:03:24.741977 4112 catalog_manager.cc:4841] TS c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097): tablet 4c6df5a87f2e4020bbdf5b1337e615c1 (table test-table [id=4cf8fb1b1b004e528902e0e67c64674a]) successfully deleted
I20260811 01:03:24.742266 4917 ts_tablet_manager.cc:1905] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 01:03:24.743171 4110 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:39921 (error 108)
I20260811 01:03:24.743361 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 4446
I20260811 01:03:24.754187 4917 ts_tablet_manager.cc:1918] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:03:24.754287 4917 log.cc:1196] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/4c6df5a87f2e4020bbdf5b1337e615c1
I20260811 01:03:24.754501 4917 ts_tablet_manager.cc:1939] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 4117417a80d94c19bf52659b2d9c22bd: Deleting consensus metadata
I20260811 01:03:24.756825 4110 catalog_manager.cc:4841] TS 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917): tablet 4c6df5a87f2e4020bbdf5b1337e615c1 (table test-table [id=4cf8fb1b1b004e528902e0e67c64674a]) successfully deleted
I20260811 01:03:24.756946 4872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:24.756750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:39921 (local address 127.0.0.1:37924)
0811 01:03:24.756841 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:24.756902 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:39921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 01:03:24.757220 4110 catalog_manager.cc:4584] TS 0f9052fd928247fda8cc62614496bbcb (127.13.30.129:39921): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4c6df5a87f2e4020bbdf5b1337e615c1: Network error: Client connection negotiation failed: client connection to 127.13.30.129:39921: connect: Connection refused (error 111)
I20260811 01:03:24.761098 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 4649
I20260811 01:03:24.776600 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 4081
I20260811 01:03:24.793802 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:37451
--webserver_interface=127.13.30.190
--webserver_port=46343
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:45167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:37451
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:24.879989 4921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:24.880220 4921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:24.880246 4921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:24.881526 4921 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:03:24.881573 4921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:24.881587 4921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:24.881598 4921 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:03:24.881609 4921 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:03:24.883649 4921 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:45167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:37451
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:37451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=46343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:24.884249 4921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:24.884615 4921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:24.895845 4931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:24.895852 4936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:24.895840 4932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:24.896111 4921 server_base.cc:1034] running on GCE node
I20260811 01:03:24.896391 4921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:24.896735 4921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:24.897872 4921 hybrid_clock.cc:648] HybridClock initialized: now 1786410204897860 us; error 33 us; skew 500 ppm
Aug 11 01:03:24 dist-test-slave-42z9 krb5kdc[4061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410204, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:24.900727 4921 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:03:24.901240 4921 webserver.cc:460] Webserver started at http://127.13.30.190:46343/ using document root <none> and password file <none>
I20260811 01:03:24.901528 4921 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:24.901592 4921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:24.902958 4921 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:03:24.903560 4947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:24.903698 4921 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:24.903788 4921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "c77d5dccc0164cdd8f491343268094a2"
format_stamp: "Formatted at 2026-08-11 01:03:23 on dist-test-slave-42z9"
server_key: "bd6f374d12cafc667c28538dee0bfdaf"
server_key_iv: "baf134f7bd451a84624171b1e4df272b"
server_key_version: "encryptionkey@0"
I20260811 01:03:24.904206 4921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:24.912744 4921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:24.914842 4921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:24.914994 4921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:24.919008 4921 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:37451
I20260811 01:03:24.919070 5038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:37451 every 8 connection(s)
I20260811 01:03:24.919451 4921 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:03:24.921195 5040 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:03:24.921897 5040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Bootstrap starting.
I20260811 01:03:24.929773 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 4921
I20260811 01:03:24.930182 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:39921
--local_ip_for_outbound_sockets=127.13.30.129
--tserver_master_addrs=127.13.30.190:37451
--webserver_port=33425
--webserver_interface=127.13.30.129
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:45167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:03:24.931032 5040 log.cc:824] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:24.933364 5040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:03:24.933679 5040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Bootstrap complete.
I20260811 01:03:24.936013 5040 raft_consensus.cc:348] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } }
I20260811 01:03:24.936246 5040 raft_consensus.cc:729] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c77d5dccc0164cdd8f491343268094a2, State: Initialized, Role: FOLLOWER
I20260811 01:03:24.936388 5040 consensus_queue.cc:260] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } }
I20260811 01:03:24.936456 5040 raft_consensus.cc:388] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:03:24.936506 5040 raft_consensus.cc:482] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:03:24.936554 5040 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:03:24.937649 5040 raft_consensus.cc:504] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } }
I20260811 01:03:24.937742 5040 leader_election.cc:302] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c77d5dccc0164cdd8f491343268094a2; no voters:
I20260811 01:03:24.937906 5040 leader_election.cc:288] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 01:03:24.937960 5044 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:03:24.938133 5044 raft_consensus.cc:686] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 2 LEADER]: Becoming Leader. State: Replica: c77d5dccc0164cdd8f491343268094a2, State: Running, Role: LEADER
I20260811 01:03:24.938210 5040 sys_catalog.cc:564] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:03:24.938279 5044 consensus_queue.cc:237] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } }
I20260811 01:03:24.938665 5044 sys_catalog.cc:455] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c77d5dccc0164cdd8f491343268094a2. Latest consensus state: current_term: 2 leader_uuid: "c77d5dccc0164cdd8f491343268094a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } } }
I20260811 01:03:24.938745 5044 sys_catalog.cc:458] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:24.939132 5046 sys_catalog.cc:455] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c77d5dccc0164cdd8f491343268094a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } } }
I20260811 01:03:24.939208 5046 sys_catalog.cc:458] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:24.939424 5058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:03:24.940250 5058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:03:24.940361 5058 catalog_manager.cc:1259] Loaded cluster ID: 0309070e9efb4dee8bee122860458981
I20260811 01:03:24.940392 5058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:03:24.940687 5058 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 01:03:24.945267 5058 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 01:03:24.948802 5058 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:03:24.949069 5058 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Loaded TSK: 0
I20260811 01:03:24.949312 5058 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:03:25.019507 5043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:25.019767 5043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:25.019805 5043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:25.021100 5043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:25.021152 5043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:25.021191 5043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:03:25.022873 5043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:45167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:39921
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=33425
--tserver_master_addrs=127.13.30.190:37451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:25.023171 5043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:25.023415 5043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:25.028697 5080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:25.028687 5076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:25.028682 5078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:25.029067 5043 server_base.cc:1034] running on GCE node
I20260811 01:03:25.029358 5043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:25.029654 5043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:25.030812 5043 hybrid_clock.cc:648] HybridClock initialized: now 1786410205030790 us; error 42 us; skew 500 ppm
Aug 11 01:03:25 dist-test-slave-42z9 krb5kdc[4061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410205, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:25.033682 5043 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:03:25.034225 5043 webserver.cc:460] Webserver started at http://127.13.30.129:33425/ using document root <none> and password file <none>
I20260811 01:03:25.034449 5043 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:25.034521 5043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:25.036089 5043 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:03:25.036863 5092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:25.037052 5043 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 01:03:25.037154 5043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "0f9052fd928247fda8cc62614496bbcb"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "62b75673b9ae7df65767898e68340caf"
server_key_iv: "3d96a7a769a442fae5971c2febed675e"
server_key_version: "encryptionkey@0"
I20260811 01:03:25.037580 5043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:25.049530 5043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:25.051816 5043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:25.051967 5043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:25.052222 5043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:25.052701 5103 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 01:03:25.054301 5043 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 01:03:25.054354 5043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 01:03:25.054388 5043 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 01:03:25.055070 5043 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 01:03:25.055114 5043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 01:03:25.055187 5103 tablet_bootstrap.cc:492] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Bootstrap starting.
I20260811 01:03:25.063179 5043 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:39921
I20260811 01:03:25.063763 5043 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:03:25.065613 5277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:39921 every 8 connection(s)
I20260811 01:03:25.066862 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 5043
I20260811 01:03:25.067212 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:46097
--local_ip_for_outbound_sockets=127.13.30.130
--tserver_master_addrs=127.13.30.190:37451
--webserver_port=43591
--webserver_interface=127.13.30.130
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:45167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:03:25.067353 5103 log.cc:824] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:25.072888 5103 tablet_bootstrap.cc:492] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:03:25.073175 5103 tablet_bootstrap.cc:492] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Bootstrap complete.
Aug 11 01:03:25 dist-test-slave-42z9 krb5kdc[4061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410205, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:25.074153 5103 ts_tablet_manager.cc:1397] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.010s
I20260811 01:03:25.075456 5103 raft_consensus.cc:348] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } }
I20260811 01:03:25.075796 5103 raft_consensus.cc:729] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f9052fd928247fda8cc62614496bbcb, State: Initialized, Role: FOLLOWER
I20260811 01:03:25.075989 5103 consensus_queue.cc:260] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } }
I20260811 01:03:25.076293 5103 ts_tablet_manager.cc:1428] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260811 01:03:25.078020 5281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.064832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:35721 (local address 127.13.30.190:37451)
0811 01:03:25.065041 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:25.065051 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:25.065342 (+ 291us) server_negotiation.cc:407] Connection header received
0811 01:03:25.066179 (+ 837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:25.066191 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:25.066263 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:25.066441 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:25.067375 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.068805 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.070610 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.071181 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.071316 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.074027 (+ 2711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:25.074031 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:25.074032 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:25.074044 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:25.076047 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:25.076574 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:25.076577 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:25.076577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:25.076697 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:25.076979 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:25.076980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:25.076980 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:25.077285 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:25.077368 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:25.077755 (+ 387us) server_negotiation.cc:299] Negotiation successful
0811 01:03:25.077869 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":94,"threads_started":1}
I20260811 01:03:25.078074 5280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.064763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:35721)
0811 01:03:25.065135 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.065182 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:25.065916 (+ 734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:25.066491 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:25.066495 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:25.066919 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:25.067213 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.067221 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.069172 (+ 1951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.069173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.070505 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.070509 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.071298 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.071300 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.071456 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.072059 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:25.072078 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:25.073896 (+ 1818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:25.076149 (+ 2253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:25.076155 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:25.076157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:25.076473 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:25.076768 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:25.076769 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:25.076769 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:25.076903 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:25.077359 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:25.077367 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:25.077561 (+ 194us) client_negotiation.cc:769] Sending connection context
0811 01:03:25.077691 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 01:03:25.077883 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":125,"threads_started":1}
I20260811 01:03:25.078764 5278 heartbeater.cc:347] Connected to a master server at 127.13.30.190:37451
I20260811 01:03:25.078860 5278 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:25.079028 5278 heartbeater.cc:511] Master 127.13.30.190:37451 requested a full tablet report, sending...
I20260811 01:03:25.079763 4976 ts_manager.cc:194] Registered new tserver with Master: 0f9052fd928247fda8cc62614496bbcb (127.13.30.129:39921)
I20260811 01:03:25.080973 4976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:35721
I20260811 01:03:25.081979 5278 heartbeater.cc:503] Master 127.13.30.190:37451 was elected leader, sending a full tablet report...
Aug 11 01:03:25 dist-test-slave-42z9 krb5kdc[4061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410204, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for kudu/127.13.30.129@KRBTEST.COM
I20260811 01:03:25.088025 5290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.080571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37934 (local address 127.13.30.129:39921)
0811 01:03:25.080727 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:25.080731 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:25.080742 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:03:25.080836 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:25.080838 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:25.080855 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:25.080929 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:25.081412 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.082338 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.083123 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.083408 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.083473 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.085389 (+ 1916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:25.085397 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:25.085398 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:25.085405 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:25.086830 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:25.087197 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:25.087200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:25.087201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:25.087258 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:25.087436 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:25.087436 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:25.087437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:25.087588 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:25.087664 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:25.087833 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 01:03:25.087928 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":123,"thread_start_us":91,"threads_started":1}
I20260811 01:03:25.088034 5289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.080462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:39921 (local address 127.0.0.1:37934)
0811 01:03:25.080647 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.080684 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:25.080761 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:25.080936 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:25.080940 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:25.081283 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:25.081348 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.081352 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.082414 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.082415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.083044 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.083047 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.083477 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.083478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.083561 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.084022 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:25.084027 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:25.085307 (+ 1280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:25.086910 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:25.086917 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:25.086919 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:25.087121 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:25.087315 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:25.087316 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:25.087316 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:25.087378 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:25.087652 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:25.087660 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:25.087715 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 01:03:25.087790 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 01:03:25.087922 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":96,"threads_started":1}
I20260811 01:03:25.088394 5176 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c6df5a87f2e4020bbdf5b1337e615c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:03:24 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:37934
I20260811 01:03:25.088932 5291 tablet_replica.cc:330] stopping tablet replica
I20260811 01:03:25.089051 5291 raft_consensus.cc:2229] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:03:25.089123 5291 raft_consensus.cc:2258] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:03:25.089494 5291 ts_tablet_manager.cc:1905] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:03:25.091763 5291 ts_tablet_manager.cc:1918] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:03:25.091842 5291 log.cc:1196] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal/wals/4c6df5a87f2e4020bbdf5b1337e615c1
I20260811 01:03:25.092078 5291 ts_tablet_manager.cc:1939] T 4c6df5a87f2e4020bbdf5b1337e615c1 P 0f9052fd928247fda8cc62614496bbcb: Deleting consensus metadata
I20260811 01:03:25.092617 4952 catalog_manager.cc:4841] TS 0f9052fd928247fda8cc62614496bbcb (127.13.30.129:39921): tablet 4c6df5a87f2e4020bbdf5b1337e615c1 (table test-table [id=4cf8fb1b1b004e528902e0e67c64674a]) successfully deleted
W20260811 01:03:25.162985 5284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:25.163244 5284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:25.163282 5284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:25.164570 5284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:25.164626 5284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:25.164664 5284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:03:25.166409 5284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:45167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:46097
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=43591
--tserver_master_addrs=127.13.30.190:37451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:25.166687 5284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:25.166934 5284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:25.172194 5309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:25.172256 5304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:25.172158 5284 server_base.cc:1034] running on GCE node
W20260811 01:03:25.172173 5303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:25.172564 5284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:25.172806 5284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:25.173941 5284 hybrid_clock.cc:648] HybridClock initialized: now 1786410205173928 us; error 28 us; skew 500 ppm
Aug 11 01:03:25 dist-test-slave-42z9 krb5kdc[4061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410205, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:25.176435 5284 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:03:25.176904 5284 webserver.cc:460] Webserver started at http://127.13.30.130:43591/ using document root <none> and password file <none>
I20260811 01:03:25.177109 5284 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:25.177168 5284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:25.178635 5284 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:03:25.179237 5317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:25.179410 5284 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:25.179495 5284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "c7a18fa8210e47d198536a3491469e59"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "d6ffe8b6ac0176b182fdf148c90f8052"
server_key_iv: "562748e695a9eb26e86bc4808cf07902"
server_key_version: "encryptionkey@0"
I20260811 01:03:25.179889 5284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:25.214038 5284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:25.216025 5284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:25.216194 5284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:25.216460 5284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:25.216776 5284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:25.216810 5284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:25.216841 5284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:25.216862 5284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:25.222811 5284 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:46097
I20260811 01:03:25.222867 5499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:46097 every 8 connection(s)
I20260811 01:03:25.223223 5284 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
Aug 11 01:03:25 dist-test-slave-42z9 krb5kdc[4061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410205, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:25.230623 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 5284
I20260811 01:03:25.230885 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:43917
--local_ip_for_outbound_sockets=127.13.30.131
--tserver_master_addrs=127.13.30.190:37451
--webserver_port=43345
--webserver_interface=127.13.30.131
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:45167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:03:25.232455 5281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.223947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:33055 (local address 127.13.30.190:37451)
0811 01:03:25.223998 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:25.224000 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:25.224200 (+ 200us) server_negotiation.cc:407] Connection header received
0811 01:03:25.224700 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:25.224701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:25.224710 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:25.224748 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:25.225730 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.226243 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.227209 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.227410 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.227461 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.229634 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:25.229637 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:25.229637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:25.229646 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:25.231099 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:25.231506 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:25.231508 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:25.231509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:25.231569 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:25.231793 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:25.231794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:25.231794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:25.231927 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:25.231984 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:25.232258 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 01:03:25.232358 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 01:03:25.232661 5503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.223925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:33055)
0811 01:03:25.224084 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.224129 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:25.224601 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:25.224810 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:25.224813 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:25.225398 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:25.225639 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.225644 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.226328 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.226328 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.227139 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.227142 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.227473 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.227474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.227572 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.228063 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:25.228071 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:25.229422 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:25.231175 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:25.231185 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:25.231188 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:25.231436 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:25.231622 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:25.231623 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:25.231623 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:25.231735 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:25.231983 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:25.231991 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:25.232134 (+ 143us) client_negotiation.cc:769] Sending connection context
0811 01:03:25.232229 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 01:03:25.232416 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":67,"threads_started":1}
I20260811 01:03:25.233121 5500 heartbeater.cc:347] Connected to a master server at 127.13.30.190:37451
I20260811 01:03:25.233222 5500 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:25.233424 5500 heartbeater.cc:511] Master 127.13.30.190:37451 requested a full tablet report, sending...
I20260811 01:03:25.233855 4976 ts_manager.cc:194] Registered new tserver with Master: c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097)
I20260811 01:03:25.234241 4976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:33055
W20260811 01:03:25.317672 5504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:25.317893 5504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:25.317925 5504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:25.319126 5504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:25.319176 5504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:25.319211 5504 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:03:25.320793 5504 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:45167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:43917
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=43345
--tserver_master_addrs=127.13.30.190:37451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:25.321058 5504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:25.321297 5504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:25.326275 5514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:25.326277 5517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:25.326459 5512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:25.326370 5504 server_base.cc:1034] running on GCE node
I20260811 01:03:25.326702 5504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:25.326946 5504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:25.328092 5504 hybrid_clock.cc:648] HybridClock initialized: now 1786410205328079 us; error 30 us; skew 500 ppm
Aug 11 01:03:25 dist-test-slave-42z9 krb5kdc[4061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410205, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:25.330715 5504 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:03:25.331194 5504 webserver.cc:460] Webserver started at http://127.13.30.131:43345/ using document root <none> and password file <none>
I20260811 01:03:25.331413 5504 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:25.331485 5504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:25.332803 5504 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:03:25.333366 5527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:25.333542 5504 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:25.333640 5504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "4117417a80d94c19bf52659b2d9c22bd"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "13633b2623cc2c8a12b752fd9a246d78"
server_key_iv: "c0778c8095b8ce2744a8ab1160aa997a"
server_key_version: "encryptionkey@0"
I20260811 01:03:25.333998 5504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:25.349843 5504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:25.352138 5504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:25.352295 5504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:25.352540 5504 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:25.352859 5504 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:25.352895 5504 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:25.352926 5504 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:25.352950 5504 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:25.358799 5504 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:43917
I20260811 01:03:25.358863 5712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:43917 every 8 connection(s)
I20260811 01:03:25.359222 5504 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
Aug 11 01:03:25 dist-test-slave-42z9 krb5kdc[4061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410205, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:25.367677 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 5504
I20260811 01:03:25.368516 5281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.359989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:43893 (local address 127.13.30.190:37451)
0811 01:03:25.360041 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:25.360043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:25.360257 (+ 214us) server_negotiation.cc:407] Connection header received
0811 01:03:25.360775 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:25.360776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:25.360788 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:25.360835 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:25.361852 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.362359 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.363325 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.363513 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.363559 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.365837 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:25.365839 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:25.365839 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:25.365847 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:25.367004 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:25.367384 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:25.367385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:25.367385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:25.367454 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:25.367760 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:25.367762 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:25.367762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:25.367906 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:25.367982 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:25.368306 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 01:03:25.368418 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 01:03:25.369055 5717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.359986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:43893)
0811 01:03:25.360133 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.360172 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:25.360688 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:25.360903 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:25.360906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:25.361551 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:25.361771 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.361777 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.362434 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.362435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.363255 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.363257 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.363576 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.363576 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.363684 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.364245 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:25.364255 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:25.365725 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:25.367079 (+ 1354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:25.367086 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:25.367088 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:25.367320 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:25.367509 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:25.367509 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:25.367510 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:25.367690 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:25.367972 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:25.367979 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:25.368128 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 01:03:25.368621 (+ 493us) client_negotiation.cc:240] Negotiation successful
0811 01:03:25.368819 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":78,"threads_started":1}
I20260811 01:03:25.369535 5714 heartbeater.cc:347] Connected to a master server at 127.13.30.190:37451
I20260811 01:03:25.369650 5714 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:25.369853 5714 heartbeater.cc:511] Master 127.13.30.190:37451 requested a full tablet report, sending...
I20260811 01:03:25.370271 4976 ts_manager.cc:194] Registered new tserver with Master: 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917)
I20260811 01:03:25.370633 4976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:43893
I20260811 01:03:25.374625 5720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.368147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33184 (local address 127.13.30.190:37451)
0811 01:03:25.368281 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:25.368283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:25.368360 (+ 77us) server_negotiation.cc:407] Connection header received
0811 01:03:25.368403 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:25.368405 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:25.368418 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:25.368491 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:25.369232 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.369931 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.370877 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.371129 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.371186 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.372328 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:25.372329 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:25.372329 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:25.372335 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:25.373641 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:25.374032 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:25.374033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:25.374034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:25.374092 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:25.374219 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:25.374219 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:25.374219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:25.374318 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:25.374444 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:25.374470 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 01:03:25.374539 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":72,"threads_started":1}
I20260811 01:03:25.375507 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:03:25.378239 5720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.375811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33192 (local address 127.13.30.190:37451)
0811 01:03:25.375865 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:25.375867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:25.375971 (+ 104us) server_negotiation.cc:407] Connection header received
0811 01:03:25.376025 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:25.376025 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:25.376055 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:25.376118 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:03:25.376197 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.376670 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.377353 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.377620 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.377681 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.377995 (+ 314us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:03:25.378092 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:03:25.378152 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:25.378165 (+ 13us) server_negotiation.cc:299] Negotiation successful
0811 01:03:25.378187 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 01:03:25.378512 4976 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:33192:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:03:25.380211 4976 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:03:25.382556 5176 tablet_service.cc:1467] Processing CreateTablet for tablet 47255c9820784d32b5c43ccddf40fdd7 (DEFAULT_TABLE table=test-table [id=e300bf6e3e2c4eb0979445be74fd70c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:03:25.382771 5176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47255c9820784d32b5c43ccddf40fdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:25.384361 5103 tablet_bootstrap.cc:492] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb: Bootstrap starting.
I20260811 01:03:25.384732 5103 tablet_bootstrap.cc:654] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:25.385561 5103 tablet_bootstrap.cc:492] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb: No bootstrap required, opened a new log
I20260811 01:03:25.385607 5103 ts_tablet_manager.cc:1397] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 01:03:25.385757 5103 raft_consensus.cc:348] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:25.385811 5103 raft_consensus.cc:374] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:25.385840 5103 raft_consensus.cc:729] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f9052fd928247fda8cc62614496bbcb, State: Initialized, Role: FOLLOWER
I20260811 01:03:25.385888 5103 consensus_queue.cc:260] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:25.385979 5103 ts_tablet_manager.cc:1428] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:25.386648 5723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.382162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:46097 (local address 127.0.0.1:43682)
0811 01:03:25.382341 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.382351 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:25.382430 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:25.382713 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:25.382715 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:25.382717 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:25.382769 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.382771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.384008 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.384009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.385367 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.385369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.386354 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.386355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.386429 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.386458 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 01:03:25.386507 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 01:03:25.386558 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":119,"threads_started":1}
I20260811 01:03:25.386648 5289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.382145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:43917 (local address 127.0.0.1:42788)
0811 01:03:25.382261 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.382270 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:25.382303 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:25.382866 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:25.382867 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:25.382869 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:25.382902 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.382903 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.384080 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.384081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.385253 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.385257 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.386353 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.386355 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.386429 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.386458 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 01:03:25.386521 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 01:03:25.386568 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":11}
I20260811 01:03:25.386682 5728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.382495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42788 (local address 127.13.30.131:43917)
0811 01:03:25.382713 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:25.382717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:25.382729 (+ 12us) server_negotiation.cc:407] Connection header received
0811 01:03:25.382767 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:25.382769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:25.382784 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:25.382867 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:25.382957 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.383978 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.385346 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.386184 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.386257 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.386318 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:25.386544 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 01:03:25.386599 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":106,"threads_started":1}
I20260811 01:03:25.386909 5725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.382286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43682 (local address 127.13.30.130:46097)
0811 01:03:25.382454 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:25.382459 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:25.382471 (+ 12us) server_negotiation.cc:407] Connection header received
0811 01:03:25.382532 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:25.382534 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:25.382551 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:25.382633 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:25.382921 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.383903 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.385472 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.386183 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.386257 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.386318 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:25.386773 (+ 455us) server_negotiation.cc:299] Negotiation successful
0811 01:03:25.386824 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":97,"threads_started":1}
I20260811 01:03:25.387677 5607 tablet_service.cc:1467] Processing CreateTablet for tablet 47255c9820784d32b5c43ccddf40fdd7 (DEFAULT_TABLE table=test-table [id=e300bf6e3e2c4eb0979445be74fd70c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:03:25.387898 5393 tablet_service.cc:1467] Processing CreateTablet for tablet 47255c9820784d32b5c43ccddf40fdd7 (DEFAULT_TABLE table=test-table [id=e300bf6e3e2c4eb0979445be74fd70c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:03:25.388049 5607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47255c9820784d32b5c43ccddf40fdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:25.388235 5393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47255c9820784d32b5c43ccddf40fdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:25.391065 5734 tablet_bootstrap.cc:492] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd: Bootstrap starting.
I20260811 01:03:25.391175 5735 tablet_bootstrap.cc:492] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59: Bootstrap starting.
I20260811 01:03:25.391718 5734 tablet_bootstrap.cc:654] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:25.391738 5735 tablet_bootstrap.cc:654] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:25.392208 5734 log.cc:824] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:25.392210 5735 log.cc:824] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:25.392938 5734 tablet_bootstrap.cc:492] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd: No bootstrap required, opened a new log
I20260811 01:03:25.393003 5734 ts_tablet_manager.cc:1397] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:03:25.393110 5735 tablet_bootstrap.cc:492] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59: No bootstrap required, opened a new log
I20260811 01:03:25.393174 5735 ts_tablet_manager.cc:1397] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:03:25.394625 5734 raft_consensus.cc:348] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:25.394774 5734 raft_consensus.cc:374] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:25.394806 5734 raft_consensus.cc:729] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4117417a80d94c19bf52659b2d9c22bd, State: Initialized, Role: FOLLOWER
I20260811 01:03:25.394797 5735 raft_consensus.cc:348] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:25.394964 5735 raft_consensus.cc:374] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:25.394948 5734 consensus_queue.cc:260] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:25.395002 5735 raft_consensus.cc:729] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7a18fa8210e47d198536a3491469e59, State: Initialized, Role: FOLLOWER
I20260811 01:03:25.395107 5735 consensus_queue.cc:260] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:25.395264 5714 heartbeater.cc:503] Master 127.13.30.190:37451 was elected leader, sending a full tablet report...
I20260811 01:03:25.395390 5735 ts_tablet_manager.cc:1428] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:03:25.395406 5500 heartbeater.cc:503] Master 127.13.30.190:37451 was elected leader, sending a full tablet report...
I20260811 01:03:25.395558 5734 ts_tablet_manager.cc:1428] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:03:25.438212 5286 raft_consensus.cc:482] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:03:25.438395 5286 raft_consensus.cc:504] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:25.438807 5286 leader_election.cc:288] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917), c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097)
I20260811 01:03:25.442256 5725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.439088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:54247 (local address 127.13.30.130:46097)
0811 01:03:25.439143 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:25.439145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:25.439160 (+ 15us) server_negotiation.cc:407] Connection header received
0811 01:03:25.439194 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:25.439196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:25.439209 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:25.439323 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:25.439489 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.440148 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.441279 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.441916 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.441970 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.441979 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:25.442166 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 01:03:25.442195 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 01:03:25.442296 5280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.438993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:46097 (local address 127.13.30.129:54247)
0811 01:03:25.439043 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.439057 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:25.439121 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:25.439336 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:25.439337 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:25.439339 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:25.439416 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.439417 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.440235 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.440236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.441204 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.441208 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.441981 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.441982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.442065 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.442095 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 01:03:25.442159 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 01:03:25.442204 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 01:03:25.442734 5740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.439004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:43917 (local address 127.13.30.129:50265)
0811 01:03:25.439437 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.439447 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:25.439512 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:25.439834 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:25.439835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:25.439838 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:25.439935 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.439936 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.440746 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.440746 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.441768 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:25.441771 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.442473 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.442474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:25.442565 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.442569 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:03:25.442624 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 01:03:25.442665 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":105,"threads_started":1}
I20260811 01:03:25.442755 5728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.439163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:50265 (local address 127.13.30.131:43917)
0811 01:03:25.439208 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:25.439210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:25.439515 (+ 305us) server_negotiation.cc:407] Connection header received
0811 01:03:25.439567 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:25.439568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:25.439576 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:25.439616 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:25.440007 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.440669 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.441846 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.442364 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.442433 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.442440 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:25.442639 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 01:03:25.442688 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 01:03:25.442942 5426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47255c9820784d32b5c43ccddf40fdd7" candidate_uuid: "0f9052fd928247fda8cc62614496bbcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a18fa8210e47d198536a3491469e59" is_pre_election: true
I20260811 01:03:25.443068 5634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47255c9820784d32b5c43ccddf40fdd7" candidate_uuid: "0f9052fd928247fda8cc62614496bbcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4117417a80d94c19bf52659b2d9c22bd" is_pre_election: true
I20260811 01:03:25.443133 5426 raft_consensus.cc:2454] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f9052fd928247fda8cc62614496bbcb in term 0.
I20260811 01:03:25.443233 5634 raft_consensus.cc:2454] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f9052fd928247fda8cc62614496bbcb in term 0.
I20260811 01:03:25.443373 5097 leader_election.cc:302] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f9052fd928247fda8cc62614496bbcb, c7a18fa8210e47d198536a3491469e59; no voters:
I20260811 01:03:25.443552 5286 raft_consensus.cc:2781] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:03:25.443610 5286 raft_consensus.cc:482] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:03:25.443626 5286 raft_consensus.cc:3037] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:25.444375 5286 raft_consensus.cc:504] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:25.444510 5286 leader_election.cc:288] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 1 election: Requested vote from peers 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917), c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097)
I20260811 01:03:25.444689 5634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47255c9820784d32b5c43ccddf40fdd7" candidate_uuid: "0f9052fd928247fda8cc62614496bbcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4117417a80d94c19bf52659b2d9c22bd"
I20260811 01:03:25.444729 5426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47255c9820784d32b5c43ccddf40fdd7" candidate_uuid: "0f9052fd928247fda8cc62614496bbcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a18fa8210e47d198536a3491469e59"
I20260811 01:03:25.444774 5634 raft_consensus.cc:3037] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:25.444810 5426 raft_consensus.cc:3037] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:25.445565 5634 raft_consensus.cc:2454] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f9052fd928247fda8cc62614496bbcb in term 1.
I20260811 01:03:25.445634 5426 raft_consensus.cc:2454] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f9052fd928247fda8cc62614496bbcb in term 1.
I20260811 01:03:25.445797 5097 leader_election.cc:302] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f9052fd928247fda8cc62614496bbcb, c7a18fa8210e47d198536a3491469e59; no voters:
I20260811 01:03:25.445914 5286 raft_consensus.cc:2781] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:03:25.446099 5286 raft_consensus.cc:686] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 LEADER]: Becoming Leader. State: Replica: 0f9052fd928247fda8cc62614496bbcb, State: Running, Role: LEADER
I20260811 01:03:25.446172 5286 consensus_queue.cc:237] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:25.446941 4975 catalog_manager.cc:5495] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f9052fd928247fda8cc62614496bbcb (127.13.30.129). New cstate: current_term: 1 leader_uuid: "0f9052fd928247fda8cc62614496bbcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } health_report { overall_health: HEALTHY } } }
I20260811 01:03:25.460748 5290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.458419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37936 (local address 127.13.30.129:39921)
0811 01:03:25.458485 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:25.458487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:25.458507 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:03:25.458548 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:25.458549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:25.458567 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:25.458627 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:03:25.458755 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.459255 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.459976 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:25.460198 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:25.460255 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:25.460412 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:03:25.460528 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:03:25.460593 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:25.460635 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 01:03:25.460661 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 01:03:25.462370 5634 raft_consensus.cc:1261] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd [term 1 FOLLOWER]: Refusing update from remote peer 0f9052fd928247fda8cc62614496bbcb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:03:25.462371 5426 raft_consensus.cc:1261] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59 [term 1 FOLLOWER]: Refusing update from remote peer 0f9052fd928247fda8cc62614496bbcb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:03:25.462728 5742 consensus_queue.cc:1035] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:03:25.462877 5286 consensus_queue.cc:1035] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:03:25.466310 5751 mvcc.cc:205] Tried to move back new op lower bound from 7317136201571155968 to 7317136201508057088. Current Snapshot: MvccSnapshot[applied={T|T < 7317136201571155968}]
I20260811 01:03:25.467698 4976 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:33192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:03:25.467809 4976 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:33192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:03:25.468686 4976 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Sending DeleteTablet for 3 replicas of tablet 47255c9820784d32b5c43ccddf40fdd7
I20260811 01:03:25.468976 5393 tablet_service.cc:1514] Processing DeleteTablet for tablet 47255c9820784d32b5c43ccddf40fdd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:03:25 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:43682
I20260811 01:03:25.469017 5176 tablet_service.cc:1514] Processing DeleteTablet for tablet 47255c9820784d32b5c43ccddf40fdd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:03:25 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:37934
I20260811 01:03:25.469074 5607 tablet_service.cc:1514] Processing DeleteTablet for tablet 47255c9820784d32b5c43ccddf40fdd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:03:25 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:42788
I20260811 01:03:25.469249 5291 tablet_replica.cc:330] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb: stopping tablet replica
I20260811 01:03:25.469285 5767 tablet_replica.cc:330] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd: stopping tablet replica
I20260811 01:03:25.469313 5291 raft_consensus.cc:2229] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:03:25.469388 5767 raft_consensus.cc:2229] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:03:25.469399 5291 raft_consensus.cc:2258] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:03:25.469432 5766 tablet_replica.cc:330] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59: stopping tablet replica
I20260811 01:03:25.469540 5767 raft_consensus.cc:2258] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:03:25.469563 5766 raft_consensus.cc:2229] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:03:25.469686 5766 raft_consensus.cc:2258] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:03:25.469825 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 5043
I20260811 01:03:25.470072 5767 ts_tablet_manager.cc:1905] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:03:25.472687 5767 ts_tablet_manager.cc:1918] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:03:25.472775 5767 log.cc:1196] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/47255c9820784d32b5c43ccddf40fdd7
I20260811 01:03:25.473059 5766 ts_tablet_manager.cc:1905] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:03:25.473086 5767 ts_tablet_manager.cc:1939] T 47255c9820784d32b5c43ccddf40fdd7 P 4117417a80d94c19bf52659b2d9c22bd: Deleting consensus metadata
I20260811 01:03:25.474175 4952 catalog_manager.cc:4841] TS 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917): tablet 47255c9820784d32b5c43ccddf40fdd7 (table test-table [id=e300bf6e3e2c4eb0979445be74fd70c1]) successfully deleted
I20260811 01:03:25.474655 5766 ts_tablet_manager.cc:1918] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:03:25.474748 5766 log.cc:1196] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/47255c9820784d32b5c43ccddf40fdd7
I20260811 01:03:25.475100 5766 ts_tablet_manager.cc:1939] T 47255c9820784d32b5c43ccddf40fdd7 P c7a18fa8210e47d198536a3491469e59: Deleting consensus metadata
I20260811 01:03:25.475647 4956 catalog_manager.cc:4841] TS c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097): tablet 47255c9820784d32b5c43ccddf40fdd7 (table test-table [id=e300bf6e3e2c4eb0979445be74fd70c1]) successfully deleted
W20260811 01:03:25.482030 4952 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:39921 (error 108)
I20260811 01:03:25.482496 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 5284
I20260811 01:03:25.482647 5289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.482502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:39921 (local address 127.0.0.1:37940)
0811 01:03:25.482557 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.482607 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:39921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 01:03:25.491163 4952 catalog_manager.cc:4584] TS 0f9052fd928247fda8cc62614496bbcb (127.13.30.129:39921): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 47255c9820784d32b5c43ccddf40fdd7: Network error: Client connection negotiation failed: client connection to 127.13.30.129:39921: connect: Connection refused (error 111)
I20260811 01:03:25.506973 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 5504
I20260811 01:03:25.531567 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 4921
I20260811 01:03:25.544158 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:37451
--webserver_interface=127.13.30.190
--webserver_port=46343
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:45167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:37451
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:25.628955 5769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:25.629201 5769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:25.629225 5769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:25.630456 5769 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:03:25.630498 5769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:25.630512 5769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:25.630524 5769 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:03:25.630535 5769 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:03:25.632090 5769 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:45167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:37451
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:37451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=46343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:25.632324 5769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:25.632541 5769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:25.637671 5780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:25.637671 5782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:25.637699 5769 server_base.cc:1034] running on GCE node
W20260811 01:03:25.637693 5779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:25.638157 5769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:25.638458 5769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:25.639598 5769 hybrid_clock.cc:648] HybridClock initialized: now 1786410205639584 us; error 26 us; skew 500 ppm
Aug 11 01:03:25 dist-test-slave-42z9 krb5kdc[4061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410205, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:25.642103 5769 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:03:25.642606 5769 webserver.cc:460] Webserver started at http://127.13.30.190:46343/ using document root <none> and password file <none>
I20260811 01:03:25.642827 5769 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:25.642880 5769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:25.644285 5769 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:03:25.644930 5791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:25.645089 5769 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:25.645177 5769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "c77d5dccc0164cdd8f491343268094a2"
format_stamp: "Formatted at 2026-08-11 01:03:23 on dist-test-slave-42z9"
server_key: "bd6f374d12cafc667c28538dee0bfdaf"
server_key_iv: "baf134f7bd451a84624171b1e4df272b"
server_key_version: "encryptionkey@0"
I20260811 01:03:25.645568 5769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:25.657361 5769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:25.659413 5769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:25.659572 5769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:25.663916 5769 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:37451
I20260811 01:03:25.663959 5876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:37451 every 8 connection(s)
I20260811 01:03:25.664376 5769 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:03:25.666226 5877 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:03:25.666975 5877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Bootstrap starting.
I20260811 01:03:25.669818 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 5769
I20260811 01:03:25.670096 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:39921
--local_ip_for_outbound_sockets=127.13.30.129
--tserver_master_addrs=127.13.30.190:37451
--webserver_port=33425
--webserver_interface=127.13.30.129
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:45167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:03:25.676584 5877 log.cc:824] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:25.678994 5877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:03:25.679323 5877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2: Bootstrap complete.
I20260811 01:03:25.681722 5877 raft_consensus.cc:348] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } }
I20260811 01:03:25.681990 5877 raft_consensus.cc:729] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c77d5dccc0164cdd8f491343268094a2, State: Initialized, Role: FOLLOWER
I20260811 01:03:25.682159 5877 consensus_queue.cc:260] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } }
I20260811 01:03:25.682242 5877 raft_consensus.cc:388] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:03:25.682297 5877 raft_consensus.cc:482] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:03:25.682348 5877 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 2 FOLLOWER]: Advancing to term 3
I20260811 01:03:25.683491 5877 raft_consensus.cc:504] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } }
I20260811 01:03:25.683601 5877 leader_election.cc:302] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c77d5dccc0164cdd8f491343268094a2; no voters:
I20260811 01:03:25.683794 5877 leader_election.cc:288] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 01:03:25.683848 5886 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 01:03:25.684005 5886 raft_consensus.cc:686] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [term 3 LEADER]: Becoming Leader. State: Replica: c77d5dccc0164cdd8f491343268094a2, State: Running, Role: LEADER
I20260811 01:03:25.684147 5877 sys_catalog.cc:564] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:03:25.684156 5886 consensus_queue.cc:237] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } }
I20260811 01:03:25.684641 5887 sys_catalog.cc:455] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c77d5dccc0164cdd8f491343268094a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } } }
I20260811 01:03:25.684744 5887 sys_catalog.cc:458] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:25.684653 5889 sys_catalog.cc:455] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c77d5dccc0164cdd8f491343268094a2. Latest consensus state: current_term: 3 leader_uuid: "c77d5dccc0164cdd8f491343268094a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c77d5dccc0164cdd8f491343268094a2" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37451 } } }
I20260811 01:03:25.684929 5889 sys_catalog.cc:458] T 00000000000000000000000000000000 P c77d5dccc0164cdd8f491343268094a2 [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:25.685261 5897 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:03:25.686224 5897 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:03:25.686398 5897 catalog_manager.cc:1259] Loaded cluster ID: 0309070e9efb4dee8bee122860458981
I20260811 01:03:25.686645 5897 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 01:03:25.687042 5897 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8a720fc9ad google::LogMessage::Fail() at ??:0
@ 0x7f8a720ff88a google::LogMessage::SendToLog() at ??:0
@ 0x7f8a720fc4de google::LogMessage::Flush() at ??:0
@ 0x7f8a720fda19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8a7a01d0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f8a7a0268b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8a73fca0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8a73fbf954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8a74e236db start_thread at ??:0
@ 0x7f8a70bfa61f clone at ??:0
W20260811 01:03:25.766553 5881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:25.766798 5881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:25.766836 5881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:25.768187 5881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:25.768234 5881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:25.768272 5881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:03:25.769986 5881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:45167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:39921
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=33425
--tserver_master_addrs=127.13.30.190:37451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:25.770251 5881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:25.770504 5881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:25.775733 5934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:25.775733 5937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:25.775712 5935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:25.776108 5881 server_base.cc:1034] running on GCE node
I20260811 01:03:25.776335 5881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:25.776602 5881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:25.777787 5881 hybrid_clock.cc:648] HybridClock initialized: now 1786410205777771 us; error 34 us; skew 500 ppm
Aug 11 01:03:25 dist-test-slave-42z9 krb5kdc[4061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410205, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:25.780580 5881 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:03:25.781091 5881 webserver.cc:460] Webserver started at http://127.13.30.129:33425/ using document root <none> and password file <none>
I20260811 01:03:25.781306 5881 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:25.781373 5881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:25.782842 5881 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:03:25.783540 5947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:25.783695 5881 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:25.783782 5881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "0f9052fd928247fda8cc62614496bbcb"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "62b75673b9ae7df65767898e68340caf"
server_key_iv: "3d96a7a769a442fae5971c2febed675e"
server_key_version: "encryptionkey@0"
I20260811 01:03:25.784142 5881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:25.795758 5881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:25.798101 5881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:25.798228 5881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:25.798480 5881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:25.798947 5958 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 01:03:25.801031 5881 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 01:03:25.801081 5881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 01:03:25.801116 5881 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 01:03:25.801860 5881 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 01:03:25.801896 5881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 01:03:25.801996 5958 tablet_bootstrap.cc:492] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb: Bootstrap starting.
I20260811 01:03:25.808936 5881 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:39921
I20260811 01:03:25.809356 5881 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:03:25.809796 6132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:39921 every 8 connection(s)
I20260811 01:03:25.813766 5958 log.cc:824] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:25.816743 5958 tablet_bootstrap.cc:492] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:03:25.817101 5958 tablet_bootstrap.cc:492] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb: Bootstrap complete.
I20260811 01:03:25.817312 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 5881
I20260811 01:03:25.817615 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:46097
--local_ip_for_outbound_sockets=127.13.30.130
--tserver_master_addrs=127.13.30.190:37451
--webserver_port=43591
--webserver_interface=127.13.30.130
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:45167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:03:25.818466 5958 ts_tablet_manager.cc:1397] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.008s
I20260811 01:03:25.820055 5958 raft_consensus.cc:348] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:25.820417 5958 raft_consensus.cc:729] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f9052fd928247fda8cc62614496bbcb, State: Initialized, Role: FOLLOWER
I20260811 01:03:25.820573 5958 consensus_queue.cc:260] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:25.820884 5958 ts_tablet_manager.cc:1428] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb: Time spent starting tablet: real 0.002s user 0.001s sys 0.003s
W20260811 01:03:25.897341 6136 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:03:25.810086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:58127)
0811 01:03:25.810300 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.810344 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:25.810805 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:25.897120 (+ 86315us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":105,"threads_started":1}
W20260811 01:03:25.897661 6133 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:37451 (0 consecutive failures): Network error: Failed to ping master at 127.13.30.190:37451: Client connection negotiation failed: client connection to 127.13.30.190:37451: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 01:03:25.898041 6136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.897906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:34031)
0811 01:03:25.897964 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.898014 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 01:03:25.898396 6136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.898291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:39897)
0811 01:03:25.898337 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.898370 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 01:03:25.898574 6133 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:03:25.907382 6144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:25.907624 6144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:25.907648 6144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:25.909058 6144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:25.909126 6144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:25.909158 6144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:03:25.910928 6144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:45167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:46097
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=43591
--tserver_master_addrs=127.13.30.190:37451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:25.911214 6144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:25.911475 6144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:25.916744 6153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:25.916906 6144 server_base.cc:1034] running on GCE node
W20260811 01:03:25.916850 6155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:25.916738 6160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:25.917263 6144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:25.917575 6144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:25.918722 6144 hybrid_clock.cc:648] HybridClock initialized: now 1786410205918710 us; error 31 us; skew 500 ppm
Aug 11 01:03:25 dist-test-slave-42z9 krb5kdc[4061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410205, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:25.921280 6144 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:03:25.921811 6144 webserver.cc:460] Webserver started at http://127.13.30.130:43591/ using document root <none> and password file <none>
I20260811 01:03:25.922057 6144 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:25.922111 6144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:25.923506 6144 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:03:25.924124 6171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:25.924273 6144 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:25.924356 6144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "c7a18fa8210e47d198536a3491469e59"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "d6ffe8b6ac0176b182fdf148c90f8052"
server_key_iv: "562748e695a9eb26e86bc4808cf07902"
server_key_version: "encryptionkey@0"
I20260811 01:03:25.924708 6144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:25.931917 6144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:25.933931 6144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:25.934074 6144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:25.934296 6144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:25.934624 6144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:25.934660 6144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:25.934684 6144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:25.934707 6144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:25.941237 6144 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:46097
I20260811 01:03:25.941309 6349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:46097 every 8 connection(s)
I20260811 01:03:25.941684 6144 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:03:25.942835 6353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.942408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:40059)
0811 01:03:25.942600 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.942687 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":99,"threads_started":1}
W20260811 01:03:25.943239 6351 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:37451 (0 consecutive failures): Network error: Failed to ping master at 127.13.30.190:37451: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
I20260811 01:03:25.943535 6353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.943426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:43515)
0811 01:03:25.943473 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.943509 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 01:03:25.943611 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 6144
I20260811 01:03:25.943840 6353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:25.943757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:43971)
0811 01:03:25.943795 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:25.943819 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 01:03:25.943867 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:43917
--local_ip_for_outbound_sockets=127.13.30.131
--tserver_master_addrs=127.13.30.190:37451
--webserver_port=43345
--webserver_interface=127.13.30.131
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:45167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:25.943956 6351 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:03:26.030788 6354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:26.031034 6354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:26.031070 6354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:26.032318 6354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:26.032366 6354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:26.032404 6354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:03:26.034109 6354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:45167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:43917
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=43345
--tserver_master_addrs=127.13.30.190:37451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:26.034402 6354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:26.034657 6354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:26.040177 6360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:26.040177 6359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:26.040450 6362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:26.040592 6354 server_base.cc:1034] running on GCE node
I20260811 01:03:26.040894 6354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:26.041203 6354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:26.042402 6354 hybrid_clock.cc:648] HybridClock initialized: now 1786410206042381 us; error 27 us; skew 500 ppm
Aug 11 01:03:26 dist-test-slave-42z9 krb5kdc[4061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410206, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:26.045773 6354 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:03:26.046342 6354 webserver.cc:460] Webserver started at http://127.13.30.131:43345/ using document root <none> and password file <none>
I20260811 01:03:26.046597 6354 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:26.046763 6354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:26.048389 6354 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:03:26.049018 6374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:26.049175 6354 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:26.049266 6354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "4117417a80d94c19bf52659b2d9c22bd"
format_stamp: "Formatted at 2026-08-11 01:03:24 on dist-test-slave-42z9"
server_key: "13633b2623cc2c8a12b752fd9a246d78"
server_key_iv: "c0778c8095b8ce2744a8ab1160aa997a"
server_key_version: "encryptionkey@0"
I20260811 01:03:26.049718 6354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:26.076944 6354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:26.079378 6354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:26.079535 6354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:26.079777 6354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:26.080107 6354 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:26.080150 6354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:26.080180 6354 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:26.080209 6354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:26.086184 6354 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:43917
I20260811 01:03:26.086254 6558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:43917 every 8 connection(s)
I20260811 01:03:26.086620 6354 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:03:26.087741 6571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:26.087322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:49467)
0811 01:03:26.087495 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:26.087588 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":88,"threads_started":1}
W20260811 01:03:26.088168 6564 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:37451 (0 consecutive failures): Network error: Failed to ping master at 127.13.30.190:37451: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
I20260811 01:03:26.088435 6571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:26.088351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:59655)
0811 01:03:26.088393 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:26.088418 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 01:03:26.088635 6571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:26.088588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:50439)
0811 01:03:26.088609 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:26.088625 (+ 16us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260811 01:03:26.088713 6564 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 01:03:26.090261 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 6354
I20260811 01:03:26.899252 6573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:26.898967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:48065)
0811 01:03:26.899153 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:26.899194 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":75,"threads_started":1}
I20260811 01:03:26.944605 6574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:26.944337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:41975)
0811 01:03:26.944498 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:26.944543 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":65,"threads_started":1}
I20260811 01:03:27.089385 6575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:27.089122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:38147)
0811 01:03:27.089280 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:27.089325 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":69,"threads_started":1}
I20260811 01:03:27.556609 6576 raft_consensus.cc:482] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:03:27.556753 6576 raft_consensus.cc:504] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:27.557133 6576 leader_election.cc:288] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917), c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097)
Aug 11 01:03:27 dist-test-slave-42z9 krb5kdc[4061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410205, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.130@KRBTEST.COM
Aug 11 01:03:27 dist-test-slave-42z9 krb5kdc[4061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410205, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.131@KRBTEST.COM
I20260811 01:03:27.570547 6581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:27.557430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:60515 (local address 127.13.30.130:46097)
0811 01:03:27.557634 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:27.557643 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:27.557660 (+ 17us) server_negotiation.cc:407] Connection header received
0811 01:03:27.558091 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:27.558094 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:27.558136 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:27.558263 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:27.559054 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:27.559928 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:27.560975 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:27.561390 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:27.561537 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:27.567179 (+ 5642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:27.567185 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:27.567185 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:27.567199 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:27.568905 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:27.569303 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:27.569306 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:27.569306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:27.569399 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:27.569651 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:27.569652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:27.569652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:27.569914 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:27.569999 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:27.570284 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 01:03:27.570415 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":103,"threads_started":1}
I20260811 01:03:27.570534 6577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:27.557308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:46097 (local address 127.13.30.129:60515)
0811 01:03:27.557468 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:27.557511 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:27.557574 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:27.558332 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:27.558335 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:27.558731 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:27.558936 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:27.558942 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:27.560038 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:27.560038 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:27.560886 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:27.560888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:27.561504 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:27.561505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:27.561616 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:27.565367 (+ 3751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:27.565374 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:27.567044 (+ 1670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:27.568985 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:27.568995 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:27.568998 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:27.569221 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:27.569475 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:27.569476 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:27.569476 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:27.569592 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:27.569979 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:27.569985 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:27.570118 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 01:03:27.570203 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 01:03:27.570412 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":53,"thread_start_us":89,"threads_started":1}
I20260811 01:03:27.570617 6578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:27.557308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:43917 (local address 127.13.30.129:45729)
0811 01:03:27.557490 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:27.557500 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:27.557565 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:27.558332 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:27.558335 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:27.558731 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:27.558936 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:27.558942 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:27.560041 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:27.560042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:27.560886 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:27.560889 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:27.561496 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:27.561498 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:27.561615 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:27.565364 (+ 3749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:27.565374 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:27.567402 (+ 2028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:27.569337 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:27.569338 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:27.569338 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:27.569560 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:27.569800 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:27.569801 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:27.569801 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:27.569869 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:27.570231 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:27.570232 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:27.570285 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 01:03:27.570342 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 01:03:27.570482 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":94,"thread_start_us":52,"threads_started":1}
I20260811 01:03:27.570678 6580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:27.557430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:45729 (local address 127.13.30.131:43917)
0811 01:03:27.557604 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:27.557617 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:27.557654 (+ 37us) server_negotiation.cc:407] Connection header received
0811 01:03:27.558101 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:27.558104 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:27.558140 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:27.558262 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:27.559056 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:27.559931 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:27.560975 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:27.561386 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:27.561637 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:27.567538 (+ 5901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:27.567543 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:27.567543 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:27.567558 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:27.569243 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:27.569644 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:27.569647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:27.569647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:27.569739 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:27.569930 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:27.569931 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:27.569931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:27.570165 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:27.570234 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:27.570434 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 01:03:27.570580 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":48,"threads_started":1}
W20260811 01:03:27.571898 5949 leader_election.cc:341] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917): Not found: Tablet not found: 47255c9820784d32b5c43ccddf40fdd7
W20260811 01:03:27.572002 5955 leader_election.cc:341] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097): Not found: Tablet not found: 47255c9820784d32b5c43ccddf40fdd7
I20260811 01:03:27.572057 5955 leader_election.cc:302] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f9052fd928247fda8cc62614496bbcb; no voters: 4117417a80d94c19bf52659b2d9c22bd, c7a18fa8210e47d198536a3491469e59
I20260811 01:03:27.572158 6576 raft_consensus.cc:2726] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:03:27.900012 6577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:27.899838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:42747)
0811 01:03:27.899910 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:27.899961 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 01:03:27.945353 6582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:27.945101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:55579)
0811 01:03:27.945227 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:27.945286 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
I20260811 01:03:28.090150 6584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:28.089921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:33313)
0811 01:03:28.090058 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:28.090103 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
I20260811 01:03:28.900892 6585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:28.900623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:35087)
0811 01:03:28.900783 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:28.900835 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":84,"threads_started":1}
I20260811 01:03:28.946126 6586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:28.945878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:47091)
0811 01:03:28.946040 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:28.946077 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":77,"threads_started":1}
I20260811 01:03:29.091236 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:29.090880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:54123)
0811 01:03:29.091114 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:29.091182 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":99,"threads_started":1}
I20260811 01:03:29.269344 6589 raft_consensus.cc:482] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:03:29.269498 6589 raft_consensus.cc:504] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:29.269670 6589 leader_election.cc:288] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917), c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097)
W20260811 01:03:29.270146 5949 leader_election.cc:341] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917): Not found: Tablet not found: 47255c9820784d32b5c43ccddf40fdd7
W20260811 01:03:29.270239 5955 leader_election.cc:341] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097): Not found: Tablet not found: 47255c9820784d32b5c43ccddf40fdd7
I20260811 01:03:29.270288 5955 leader_election.cc:302] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f9052fd928247fda8cc62614496bbcb; no voters: 4117417a80d94c19bf52659b2d9c22bd, c7a18fa8210e47d198536a3491469e59
I20260811 01:03:29.270356 6589 raft_consensus.cc:2726] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:03:29.901707 6590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:29.901421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:57671)
0811 01:03:29.901606 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:29.901654 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":74,"threads_started":1}
I20260811 01:03:29.946836 6591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:29.946623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:38699)
0811 01:03:29.946744 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:29.946780 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":64,"threads_started":1}
I20260811 01:03:30.092286 6592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:30.091879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:57661)
0811 01:03:30.092129 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:30.092206 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":103,"threads_started":1}
I20260811 01:03:30.902782 6593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:30.902358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:56459)
0811 01:03:30.902602 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:30.902688 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":98,"threads_started":1}
I20260811 01:03:30.947683 6599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:30.947397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:43095)
0811 01:03:30.947577 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:30.947627 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":84,"threads_started":1}
I20260811 01:03:31.093412 6603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:31.093036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:48155)
0811 01:03:31.093254 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:31.093332 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":77,"threads_started":1}
I20260811 01:03:31.192086 6605 raft_consensus.cc:482] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:03:31.192212 6605 raft_consensus.cc:504] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:31.192400 6605 leader_election.cc:288] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917), c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097)
W20260811 01:03:31.192830 5949 leader_election.cc:341] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917): Not found: Tablet not found: 47255c9820784d32b5c43ccddf40fdd7
W20260811 01:03:31.192910 5955 leader_election.cc:341] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097): Not found: Tablet not found: 47255c9820784d32b5c43ccddf40fdd7
I20260811 01:03:31.192950 5955 leader_election.cc:302] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f9052fd928247fda8cc62614496bbcb; no voters: 4117417a80d94c19bf52659b2d9c22bd, c7a18fa8210e47d198536a3491469e59
I20260811 01:03:31.193019 6605 raft_consensus.cc:2726] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:03:31.903785 6606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:31.903492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:44785)
0811 01:03:31.903657 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:31.903708 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":76,"threads_started":1}
I20260811 01:03:31.948426 6607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:31.948207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:41713)
0811 01:03:31.948337 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:31.948378 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260811 01:03:32.094427 6608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:32.094134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:44471)
0811 01:03:32.094308 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:32.094358 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":90,"threads_started":1}
I20260811 01:03:32.904543 6609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:32.904300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:41875)
0811 01:03:32.904450 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:32.904492 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":92,"threads_started":1}
I20260811 01:03:32.949196 6610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:32.948908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:35973)
0811 01:03:32.949094 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:32.949145 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":91,"threads_started":1}
I20260811 01:03:33.095248 6611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:33.094961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:57805)
0811 01:03:33.095149 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:33.095196 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":75,"threads_started":1}
I20260811 01:03:33.254571 6614 raft_consensus.cc:482] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:03:33.254683 6614 raft_consensus.cc:504] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:33.254858 6614 leader_election.cc:288] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917), c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097)
W20260811 01:03:33.255273 5949 leader_election.cc:341] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917): Not found: Tablet not found: 47255c9820784d32b5c43ccddf40fdd7
W20260811 01:03:33.255364 5955 leader_election.cc:341] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097): Not found: Tablet not found: 47255c9820784d32b5c43ccddf40fdd7
I20260811 01:03:33.255414 5955 leader_election.cc:302] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f9052fd928247fda8cc62614496bbcb; no voters: 4117417a80d94c19bf52659b2d9c22bd, c7a18fa8210e47d198536a3491469e59
I20260811 01:03:33.255491 6614 raft_consensus.cc:2726] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:03:33.905515 6617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:33.905195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:43935)
0811 01:03:33.905370 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:33.905423 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":83,"threads_started":1}
I20260811 01:03:33.950007 6618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:33.949774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:53413)
0811 01:03:33.949905 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:33.949955 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
I20260811 01:03:34.096048 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:34.095813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:37061)
0811 01:03:34.095946 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:34.095996 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":71,"threads_started":1}
I20260811 01:03:34.906212 6620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:34.905988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:52193)
0811 01:03:34.906120 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:34.906162 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":67,"threads_started":1}
I20260811 01:03:34.950767 6621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:34.950489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:37469)
0811 01:03:34.950675 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:34.950719 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":92,"threads_started":1}
I20260811 01:03:35.096779 6624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:35.096531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:46685)
0811 01:03:35.096696 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:35.096732 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":89,"threads_started":1}
I20260811 01:03:35.472831 6627 raft_consensus.cc:482] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:03:35.472949 6627 raft_consensus.cc:504] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4117417a80d94c19bf52659b2d9c22bd" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 43917 } } peers { permanent_uuid: "c7a18fa8210e47d198536a3491469e59" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 46097 } } peers { permanent_uuid: "0f9052fd928247fda8cc62614496bbcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 39921 } }
I20260811 01:03:35.473131 6627 leader_election.cc:288] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917), c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097)
W20260811 01:03:35.473548 5955 leader_election.cc:341] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c7a18fa8210e47d198536a3491469e59 (127.13.30.130:46097): Not found: Tablet not found: 47255c9820784d32b5c43ccddf40fdd7
W20260811 01:03:35.473639 5949 leader_election.cc:341] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4117417a80d94c19bf52659b2d9c22bd (127.13.30.131:43917): Not found: Tablet not found: 47255c9820784d32b5c43ccddf40fdd7
I20260811 01:03:35.473748 5949 leader_election.cc:302] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f9052fd928247fda8cc62614496bbcb; no voters: 4117417a80d94c19bf52659b2d9c22bd, c7a18fa8210e47d198536a3491469e59
I20260811 01:03:35.473834 6627 raft_consensus.cc:2726] T 47255c9820784d32b5c43ccddf40fdd7 P 0f9052fd928247fda8cc62614496bbcb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:03:35.907151 6628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:35.906743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:40759)
0811 01:03:35.906987 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:35.907072 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":77,"threads_started":1}
I20260811 01:03:35.951574 6629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:35.951323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:60633)
0811 01:03:35.951477 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:35.951521 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
I20260811 01:03:36.097703 6630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:36.097416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:58427)
0811 01:03:36.097608 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:36.097652 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":115,"threads_started":1}
I20260811 01:03:36.908092 6632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:36.907803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:34361)
0811 01:03:36.907993 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:36.908040 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":92,"threads_started":1}
I20260811 01:03:36.952472 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:36.952175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:60989)
0811 01:03:36.952351 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:36.952408 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":105,"threads_started":1}
I20260811 01:03:37.098484 6635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:37.098251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:41559)
0811 01:03:37.098391 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:37.098434 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
I20260811 01:03:37.908919 6637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:37.908660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:35023)
0811 01:03:37.908811 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:37.908861 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
I20260811 01:03:37.953507 6639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:37.953136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:36277)
0811 01:03:37.953327 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:37.953394 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":80,"threads_started":1}
I20260811 01:03:38.099421 6643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:38.099078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:56745)
0811 01:03:38.099301 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:38.099357 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":91,"threads_started":1}
I20260811 01:03:38.909792 6644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:38.909544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:53649)
0811 01:03:38.909690 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:38.909740 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":67,"threads_started":1}
I20260811 01:03:38.954346 6645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:38.954098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:35767)
0811 01:03:38.954244 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:38.954294 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
I20260811 01:03:39.100229 6648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:39.099945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:58113)
0811 01:03:39.100131 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:39.100178 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":74,"threads_started":1}
I20260811 01:03:39.910554 6651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:39.910310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:42557)
0811 01:03:39.910456 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:39.910504 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":85,"threads_started":1}
I20260811 01:03:39.955124 6652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:39.954870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:35079)
0811 01:03:39.955034 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:39.955073 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":79,"threads_started":1}
I20260811 01:03:40.101071 6654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:40.100819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:47385)
0811 01:03:40.100968 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:40.101017 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260811 01:03:40.911363 6656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:40.911140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.129:37837)
0811 01:03:40.911272 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:40.911315 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":72,"threads_started":1}
I20260811 01:03:40.955907 6657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:40.955690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.130:39785)
0811 01:03:40.955814 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:40.955851 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260811 01:03:41.093504 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 5881
I20260811 01:03:41.107050 6659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:41.103667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37451 (local address 127.13.30.131:46655)
0811 01:03:41.106906 (+ 3239us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:41.106987 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:37451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3210,"thread_start_us":65,"threads_started":1}
I20260811 01:03:41.111662 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 6144
I20260811 01:03:41.123826 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 6354
2026-08-11T01:03:41Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18706 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:03:41 dist-test-slave-42z9 krb5kdc[6662](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:03:41 dist-test-slave-42z9 krb5kdc[6662](info): set up 2 sockets
Aug 11 01:03:41 dist-test-slave-42z9 krb5kdc[6662](info): commencing operation
krb5kdc: starting...
W20260811 01:03:42.313194 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:03:42 dist-test-slave-42z9 krb5kdc[6662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410222, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:03:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:03:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:03:42.444478 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:35391
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:37693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:35391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:42.531517 6682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:42.531757 6682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:42.531793 6682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:42.533097 6682 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 01:03:42.533147 6682 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 01:03:42.533165 6682 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 01:03:42.533180 6682 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:03:42.533197 6682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:42.533216 6682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:42.533237 6682 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:03:42.533262 6682 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:03:42.534996 6682 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:37693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:35391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:35391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:42.535296 6682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:42.535543 6682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:42.540959 6698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:42.540974 6690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:42.541008 6682 server_base.cc:1034] running on GCE node
W20260811 01:03:42.540980 6695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:42.541626 6682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:42.541980 6682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:42.543269 6682 hybrid_clock.cc:648] HybridClock initialized: now 1786410222543224 us; error 36 us; skew 500 ppm
Aug 11 01:03:42 dist-test-slave-42z9 krb5kdc[6662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410222, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:42.546576 6682 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:03:42.547101 6682 webserver.cc:460] Webserver started at http://127.13.30.190:33103/ using document root <none> and password file <none>
I20260811 01:03:42.547307 6682 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:42.547350 6682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:42.547457 6682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:03:42.548586 6682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "b45e327162abdef701779524dc4ad7c7"
server_key_iv: "70c5587fde7a3194c6b3f9ca553490fa"
server_key_version: "encryptionkey@0"
I20260811 01:03:42.548933 6682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "b45e327162abdef701779524dc4ad7c7"
server_key_iv: "70c5587fde7a3194c6b3f9ca553490fa"
server_key_version: "encryptionkey@0"
I20260811 01:03:42.550362 6682 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:03:42.551116 6712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:42.551296 6682 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:42.551388 6682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "b45e327162abdef701779524dc4ad7c7"
server_key_iv: "70c5587fde7a3194c6b3f9ca553490fa"
server_key_version: "encryptionkey@0"
I20260811 01:03:42.551458 6682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:42.559336 6682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:42.561208 6682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:42.561327 6682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:42.565407 6682 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:35391
I20260811 01:03:42.565495 6800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:35391 every 8 connection(s)
I20260811 01:03:42.565857 6682 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:03:42.566869 6801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:42.569387 6801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Bootstrap starting.
I20260811 01:03:42.570130 6801 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:42.570453 6801 log.cc:824] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:42.570962 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 6682
I20260811 01:03:42.571064 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:03:42.571257 13434 external_mini_cluster.cc:1428] Setting key 9e74185b4881f4dd2b5dbf0ef660fded
I20260811 01:03:42.571352 6801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: No bootstrap required, opened a new log
I20260811 01:03:42.573745 6801 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } }
I20260811 01:03:42.573971 6801 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:42.574012 6801 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93ca4f60d5bd4e2c909fe86310d4ddfa, State: Initialized, Role: FOLLOWER
I20260811 01:03:42.574162 6801 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } }
I20260811 01:03:42.574244 6801 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:03:42.574280 6801 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:03:42.574330 6801 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:42.575206 6801 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } }
I20260811 01:03:42.575336 6801 leader_election.cc:302] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93ca4f60d5bd4e2c909fe86310d4ddfa; no voters:
I20260811 01:03:42.575551 6801 leader_election.cc:288] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:03:42.575611 6808 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:03:42.575791 6808 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 1 LEADER]: Becoming Leader. State: Replica: 93ca4f60d5bd4e2c909fe86310d4ddfa, State: Running, Role: LEADER
I20260811 01:03:42.575870 6801 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:03:42.575899 6808 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } }
I20260811 01:03:42.576248 6808 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } } }
I20260811 01:03:42.576346 6808 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:42.576505 6808 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93ca4f60d5bd4e2c909fe86310d4ddfa. Latest consensus state: current_term: 1 leader_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } } }
I20260811 01:03:42.576627 6808 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: This master's current role is: LEADER
I20260811 01:03:42.577368 6820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:03:42.578301 6820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:03:42.580073 6820 catalog_manager.cc:1347] Generated new cluster ID: bd97ef02b87c44afbe44f8e5301c0729
I20260811 01:03:42.580129 6820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 01:03:42 dist-test-slave-42z9 krb5kdc[6662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410222, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:42.584878 6806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:42.571802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43870 (local address 127.13.30.190:35391)
0811 01:03:42.572005 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:42.572016 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:42.572055 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:03:42.572847 (+ 792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:42.572859 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:42.572931 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:42.573096 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:42.573735 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:42.575459 (+ 1724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:42.576568 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:42.577426 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:42.577576 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:42.580834 (+ 3258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:42.580839 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:42.580839 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:42.580853 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:42.582873 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:42.583268 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:42.583271 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:42.583272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:42.583374 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:42.583547 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:42.583547 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:42.583548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:42.583858 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:42.583990 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:42.584491 (+ 501us) server_negotiation.cc:299] Negotiation successful
0811 01:03:42.584631 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":90,"threads_started":1}
I20260811 01:03:42.593744 6820 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:03:42.594331 6820 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:03:42.600776 6820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Generated new TSK 0
I20260811 01:03:42.600981 6820 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:03:42.632443 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35391
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:37693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:42.719530 6838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:42.719765 6838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:42.719792 6838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:42.720974 6838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:42.721012 6838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:42.721040 6838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:03:42.722611 6838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:37693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:42.722827 6838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:42.723014 6838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:42.727805 6847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:42.727836 6846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:42.728004 6838 server_base.cc:1034] running on GCE node
W20260811 01:03:42.728016 6849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:42.728250 6838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:42.728488 6838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:42.729630 6838 hybrid_clock.cc:648] HybridClock initialized: now 1786410222729622 us; error 52 us; skew 500 ppm
Aug 11 01:03:42 dist-test-slave-42z9 krb5kdc[6662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410222, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:42.732106 6838 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:03:42.732555 6838 webserver.cc:460] Webserver started at http://127.13.30.129:44087/ using document root <none> and password file <none>
I20260811 01:03:42.732781 6838 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:42.732831 6838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:42.732960 6838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:03:42.734177 6838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "fd7f7c369f604f18a121656d20e59ed7"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "b27a8253c6e51b59a429b6399e9711cb"
server_key_iv: "3a715c272f9ef7b5172df2e7c06b8546"
server_key_version: "encryptionkey@0"
I20260811 01:03:42.734542 6838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "fd7f7c369f604f18a121656d20e59ed7"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "b27a8253c6e51b59a429b6399e9711cb"
server_key_iv: "3a715c272f9ef7b5172df2e7c06b8546"
server_key_version: "encryptionkey@0"
I20260811 01:03:42.735941 6838 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:03:42.736840 6859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:42.737066 6838 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:03:42.737169 6838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "fd7f7c369f604f18a121656d20e59ed7"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "b27a8253c6e51b59a429b6399e9711cb"
server_key_iv: "3a715c272f9ef7b5172df2e7c06b8546"
server_key_version: "encryptionkey@0"
I20260811 01:03:42.737242 6838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:42.746021 6838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:42.748253 6838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:42.748402 6838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:42.748636 6838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:42.748945 6838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:42.748987 6838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:42.749019 6838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:42.749042 6838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:42.754972 6838 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:40519
I20260811 01:03:42.755040 7038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:40519 every 8 connection(s)
I20260811 01:03:42.755357 6838 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:03:42.758782 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 6838
I20260811 01:03:42.758894 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:03:42.759127 13434 external_mini_cluster.cc:1428] Setting key 9850a879eccf31738e039c13b4bd3be1
Aug 11 01:03:42 dist-test-slave-42z9 krb5kdc[6662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410222, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:42.766359 6806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:42.756110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:48375 (local address 127.13.30.190:35391)
0811 01:03:42.756173 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:42.756175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:42.756383 (+ 208us) server_negotiation.cc:407] Connection header received
0811 01:03:42.756916 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:42.756917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:42.756928 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:42.756995 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:42.758030 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:42.758552 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:42.759957 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:42.760157 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:42.760214 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:42.762876 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:42.762879 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:42.762879 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:42.762888 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:42.764429 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:42.764893 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:42.764895 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:42.764895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:42.764970 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:42.765538 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:42.765540 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:42.765540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:42.765716 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:42.765801 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:42.766137 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 01:03:42.766254 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 01:03:42.766451 7042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:42.756084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:48375)
0811 01:03:42.756256 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:42.756301 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:42.756800 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:42.757059 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:42.757063 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:42.757737 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:42.757944 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:42.757949 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:42.758675 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:42.758676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:42.759876 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:42.759881 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:42.760248 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:42.760249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:42.760389 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:42.760922 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:42.760934 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:42.762758 (+ 1824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:42.764543 (+ 1785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:42.764553 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:42.764555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:42.764803 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:42.765033 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:42.765034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:42.765035 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:42.765162 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:42.765818 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:42.765827 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:42.765980 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 01:03:42.766084 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 01:03:42.766241 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":85,"threads_started":1}
I20260811 01:03:42.767041 7040 heartbeater.cc:347] Connected to a master server at 127.13.30.190:35391
I20260811 01:03:42.767175 7040 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:42.767417 7040 heartbeater.cc:511] Master 127.13.30.190:35391 requested a full tablet report, sending...
I20260811 01:03:42.768029 6738 ts_manager.cc:194] Registered new tserver with Master: fd7f7c369f604f18a121656d20e59ed7 (127.13.30.129:40519)
I20260811 01:03:42.768661 6738 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:48375
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:03:42.788552 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35391
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:37693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:42.875794 7046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:42.876039 7046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:42.876080 7046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:42.877357 7046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:42.877406 7046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:42.877465 7046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:03:42.879033 7046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:37693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:42.879254 7046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:42.879477 7046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:42.884665 7059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:42.884828 7053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:42.884662 7054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:42.884904 7046 server_base.cc:1034] running on GCE node
I20260811 01:03:42.885159 7046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:42.885461 7046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:42.886624 7046 hybrid_clock.cc:648] HybridClock initialized: now 1786410222886613 us; error 32 us; skew 500 ppm
Aug 11 01:03:42 dist-test-slave-42z9 krb5kdc[6662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410222, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:42.889230 7046 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:03:42.889755 7046 webserver.cc:460] Webserver started at http://127.13.30.130:33751/ using document root <none> and password file <none>
I20260811 01:03:42.889995 7046 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:42.890044 7046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:42.890167 7046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:03:42.891287 7046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "a1f3b428c8a7451197a3e54a1c1bab79"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "6e5b3a0f61437bc5f6a512a0ca9aaad0"
server_key_iv: "efa402a338577517eb5e8bfa013f3516"
server_key_version: "encryptionkey@0"
I20260811 01:03:42.891645 7046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "a1f3b428c8a7451197a3e54a1c1bab79"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "6e5b3a0f61437bc5f6a512a0ca9aaad0"
server_key_iv: "efa402a338577517eb5e8bfa013f3516"
server_key_version: "encryptionkey@0"
I20260811 01:03:42.893064 7046 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:03:42.893875 7069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:42.894218 7046 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 01:03:42.894392 7046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "a1f3b428c8a7451197a3e54a1c1bab79"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "6e5b3a0f61437bc5f6a512a0ca9aaad0"
server_key_iv: "efa402a338577517eb5e8bfa013f3516"
server_key_version: "encryptionkey@0"
I20260811 01:03:42.894503 7046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:42.904271 7046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:42.906885 7046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:42.907024 7046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:42.907310 7046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:42.907673 7046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:42.907716 7046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:42.907749 7046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:42.907764 7046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:42.914222 7046 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:43009
I20260811 01:03:42.914271 7233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:43009 every 8 connection(s)
I20260811 01:03:42.914623 7046 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:03:42.915776 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 7046
I20260811 01:03:42.915864 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:03:42.916069 13434 external_mini_cluster.cc:1428] Setting key 447110254b6951efdc8f388ae0b080fa
Aug 11 01:03:42 dist-test-slave-42z9 krb5kdc[6662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410222, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:42.924544 6806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:42.915349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:59315 (local address 127.13.30.190:35391)
0811 01:03:42.915434 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:42.915436 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:42.915598 (+ 162us) server_negotiation.cc:407] Connection header received
0811 01:03:42.916167 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:42.916169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:42.916183 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:42.916236 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:42.917347 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:42.917918 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:42.918904 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:42.919115 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:42.919174 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:42.921737 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:42.921738 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:42.921739 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:42.921747 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:42.923113 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:42.923556 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:42.923557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:42.923557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:42.923618 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:42.923856 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:42.923857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:42.923857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:42.923993 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:42.924053 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:42.924344 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 01:03:42.924443 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 01:03:42.924741 7236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:42.915314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:59315)
0811 01:03:42.915481 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:42.915520 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:42.916066 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:42.916375 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:42.916379 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:42.917033 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:42.917243 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:42.917249 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:42.918007 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:42.918008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:42.918816 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:42.918818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:42.919190 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:42.919191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:42.919329 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:42.919867 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:42.919885 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:42.921628 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:42.923203 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:42.923212 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:42.923216 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:42.923479 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:42.923678 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:42.923679 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:42.923680 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:42.923792 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:42.924053 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:42.924062 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:42.924210 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 01:03:42.924306 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 01:03:42.924523 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
I20260811 01:03:42.925414 7234 heartbeater.cc:347] Connected to a master server at 127.13.30.190:35391
I20260811 01:03:42.925550 7234 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:42.925751 7234 heartbeater.cc:511] Master 127.13.30.190:35391 requested a full tablet report, sending...
I20260811 01:03:42.926151 6738 ts_manager.cc:194] Registered new tserver with Master: a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009)
I20260811 01:03:42.926550 6738 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:59315
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:03:42.944948 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35391
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:37693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:03:43.031632 7241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:03:43.031875 7241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:03:43.031903 7241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:03:43.033141 7241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:03:43.033191 7241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:03:43.033218 7241 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:03:43.034931 7241 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:37693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:03:43.035197 7241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:03:43.035408 7241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:03:43.040849 7249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:43.040934 7253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:03:43.040849 7248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:03:43.041230 7241 server_base.cc:1034] running on GCE node
I20260811 01:03:43.041476 7241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:03:43.041726 7241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:03:43.042869 7241 hybrid_clock.cc:648] HybridClock initialized: now 1786410223042860 us; error 31 us; skew 500 ppm
Aug 11 01:03:43 dist-test-slave-42z9 krb5kdc[6662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410223, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:03:43.045680 7241 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:03:43.046401 7241 webserver.cc:460] Webserver started at http://127.13.30.131:45445/ using document root <none> and password file <none>
I20260811 01:03:43.046705 7241 fs_manager.cc:359] Metadata directory not provided
I20260811 01:03:43.046759 7241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:03:43.046903 7241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:03:43.048378 7241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "dc3f94b4d6814e45ab81a44e7e671389"
format_stamp: "Formatted at 2026-08-11 01:03:43 on dist-test-slave-42z9"
server_key: "db278623ed81d742fca3881f7c394973"
server_key_iv: "b783d1fa6bae55fb457ce08754ec42aa"
server_key_version: "encryptionkey@0"
I20260811 01:03:43.048825 7241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "dc3f94b4d6814e45ab81a44e7e671389"
format_stamp: "Formatted at 2026-08-11 01:03:43 on dist-test-slave-42z9"
server_key: "db278623ed81d742fca3881f7c394973"
server_key_iv: "b783d1fa6bae55fb457ce08754ec42aa"
server_key_version: "encryptionkey@0"
I20260811 01:03:43.050428 7241 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 01:03:43.051259 7264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:43.051415 7241 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:03:43.051508 7241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "dc3f94b4d6814e45ab81a44e7e671389"
format_stamp: "Formatted at 2026-08-11 01:03:43 on dist-test-slave-42z9"
server_key: "db278623ed81d742fca3881f7c394973"
server_key_iv: "b783d1fa6bae55fb457ce08754ec42aa"
server_key_version: "encryptionkey@0"
I20260811 01:03:43.051589 7241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:03:43.081102 7241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:03:43.083395 7241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:03:43.083539 7241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:03:43.083768 7241 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:03:43.084071 7241 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:03:43.084105 7241 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:43.084136 7241 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:03:43.084159 7241 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:03:43.090245 7241 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:38135
I20260811 01:03:43.090307 7430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:38135 every 8 connection(s)
I20260811 01:03:43.090642 7241 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:03:43.091694 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 7241
I20260811 01:03:43.091789 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:03:43.091970 13434 external_mini_cluster.cc:1428] Setting key f10dac09c7abfd68d689a23556136359
Aug 11 01:03:43 dist-test-slave-42z9 krb5kdc[6662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410223, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:03:43.099967 6806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.091360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:43245 (local address 127.13.30.190:35391)
0811 01:03:43.091431 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:43.091434 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:43.091667 (+ 233us) server_negotiation.cc:407] Connection header received
0811 01:03:43.092395 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:43.092396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:43.092411 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:43.092460 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:43.093538 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.094070 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.095026 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.095212 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.095258 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:43.097388 (+ 2130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:43.097389 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:43.097389 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:43.097396 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:43.098767 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:43.099152 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:43.099153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:43.099153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:43.099214 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:43.099453 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:43.099453 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:43.099453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:43.099566 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:43.099614 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:43.099829 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 01:03:43.099894 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 01:03:43.100172 7433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.091325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:43245)
0811 01:03:43.091518 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:43.091572 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:43.092275 (+ 703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:43.092536 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:43.092541 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:43.093196 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:03:43.093409 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:43.093414 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.094145 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.094146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:43.094959 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:43.094961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.095268 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.095269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:43.095379 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:43.095854 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:03:43.095863 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:03:43.097292 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:03:43.098851 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:43.098859 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:43.098861 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:43.099089 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:43.099272 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:03:43.099273 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:03:43.099273 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:03:43.099390 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:03:43.099611 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:03:43.099614 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:03:43.099733 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 01:03:43.099812 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 01:03:43.099947 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":97,"threads_started":1}
I20260811 01:03:43.100669 7431 heartbeater.cc:347] Connected to a master server at 127.13.30.190:35391
I20260811 01:03:43.100775 7431 heartbeater.cc:464] Registering TS with master...
I20260811 01:03:43.100986 7431 heartbeater.cc:511] Master 127.13.30.190:35391 requested a full tablet report, sending...
I20260811 01:03:43.101364 6738 ts_manager.cc:194] Registered new tserver with Master: dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135)
I20260811 01:03:43.101758 6738 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:43245
I20260811 01:03:43.103598 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:03:43.111299 6806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.104936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43878 (local address 127.13.30.190:35391)
0811 01:03:43.105000 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:43.105002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:43.105078 (+ 76us) server_negotiation.cc:407] Connection header received
0811 01:03:43.105142 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:43.105143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:43.105153 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:43.105197 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:03:43.105807 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.106294 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.107021 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.107215 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.107271 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:43.108732 (+ 1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:03:43.108734 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:03:43.108734 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:03:43.108742 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:03:43.110106 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:43.110444 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:43.110446 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:43.110446 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:43.110518 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:03:43.110694 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:03:43.110695 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:03:43.110695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:03:43.110874 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:03:43.110975 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:43.111103 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 01:03:43.111200 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 01:03:43.113137 6738 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:03:43.114948 6738 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:03:43.122284 7450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.117759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:38135 (local address 127.0.0.1:39788)
0811 01:03:43.118313 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:43.118321 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:43.118358 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:43.118617 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:43.118618 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:43.118621 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:43.118671 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:43.118672 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.119670 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.119671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:43.120966 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:43.120970 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.121897 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.121899 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:43.122024 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:43.122045 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 01:03:43.122116 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 01:03:43.122181 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"mutex_wait_us":26,"spinlock_wait_cycles":384,"thread_start_us":97,"threads_started":1}
I20260811 01:03:43.122362 7455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.117956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55434 (local address 127.13.30.130:43009)
0811 01:03:43.118155 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:43.118161 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:43.118175 (+ 14us) server_negotiation.cc:407] Connection header received
0811 01:03:43.118284 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:43.118286 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:43.118299 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:43.118377 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:43.118580 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.119960 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.121234 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.121957 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.122053 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:43.122109 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:43.122230 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 01:03:43.122273 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":95,"threads_started":1}
I20260811 01:03:43.122392 7453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.117757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:43009 (local address 127.0.0.1:55434)
0811 01:03:43.118077 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:43.118123 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:43.118194 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:43.118396 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:43.118399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:43.118402 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:43.118497 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:43.118500 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.120089 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.120091 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:43.121157 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:43.121159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.122078 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.122079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:43.122152 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:43.122156 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:03:43.122207 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 01:03:43.122256 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":2,"thread_start_us":85,"threads_started":1}
I20260811 01:03:43.122695 7459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.118146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39788 (local address 127.13.30.131:38135)
0811 01:03:43.118344 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:43.118348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:43.118358 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:03:43.118454 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:43.118456 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:43.118473 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:43.118525 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:43.118788 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.119562 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.121050 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.121812 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.121894 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:43.121961 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:43.122554 (+ 593us) server_negotiation.cc:299] Negotiation successful
0811 01:03:43.122612 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":96,"threads_started":1}
I20260811 01:03:43.123518 7335 tablet_service.cc:1467] Processing CreateTablet for tablet 31ecd0c497a04b55b46d0791f259b445 (DEFAULT_TABLE table=test-table [id=ee5ad284109d4c4e814b4f1f227f5d89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:03:43.123513 7143 tablet_service.cc:1467] Processing CreateTablet for tablet 31ecd0c497a04b55b46d0791f259b445 (DEFAULT_TABLE table=test-table [id=ee5ad284109d4c4e814b4f1f227f5d89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:03:43.123929 7335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31ecd0c497a04b55b46d0791f259b445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:43.123934 7447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.117766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40519 (local address 127.0.0.1:49636)
0811 01:03:43.118577 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:43.118586 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:43.118640 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:43.118803 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:43.118804 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:43.118806 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:43.118839 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:43.118841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.121229 (+ 2388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.121230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:43.121998 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:43.122000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.123673 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.123674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:43.123748 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:43.123754 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 01:03:43.123812 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 01:03:43.123863 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":796,"thread_start_us":112,"threads_started":1}
I20260811 01:03:43.123936 7143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31ecd0c497a04b55b46d0791f259b445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:43.123956 7458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.118062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49636 (local address 127.13.30.129:40519)
0811 01:03:43.118545 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:43.118548 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:43.118642 (+ 94us) server_negotiation.cc:407] Connection header received
0811 01:03:43.118713 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:43.118716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:43.118733 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:43.118810 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:43.118895 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.119975 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.122111 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.123574 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.123656 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:43.123717 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:43.123826 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 01:03:43.123874 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":96,"threads_started":1}
I20260811 01:03:43.127018 7461 tablet_bootstrap.cc:492] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79: Bootstrap starting.
I20260811 01:03:43.127820 7463 tablet_bootstrap.cc:492] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389: Bootstrap starting.
I20260811 01:03:43.127823 6938 tablet_service.cc:1467] Processing CreateTablet for tablet 31ecd0c497a04b55b46d0791f259b445 (DEFAULT_TABLE table=test-table [id=ee5ad284109d4c4e814b4f1f227f5d89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:03:43.128224 6938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31ecd0c497a04b55b46d0791f259b445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:03:43.128633 7463 tablet_bootstrap.cc:654] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:43.129287 7463 log.cc:824] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:43.130004 7461 tablet_bootstrap.cc:654] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:43.130458 7463 tablet_bootstrap.cc:492] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389: No bootstrap required, opened a new log
I20260811 01:03:43.130577 7463 ts_tablet_manager.cc:1397] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 01:03:43.130909 7461 log.cc:824] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:43.131832 7468 tablet_bootstrap.cc:492] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Bootstrap starting.
I20260811 01:03:43.131989 7461 tablet_bootstrap.cc:492] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79: No bootstrap required, opened a new log
I20260811 01:03:43.132088 7461 ts_tablet_manager.cc:1397] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 01:03:43.132761 7468 tablet_bootstrap.cc:654] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Neither blocks nor log segments found. Creating new log.
I20260811 01:03:43.133008 7463 raft_consensus.cc:348] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:03:43.133281 7463 raft_consensus.cc:374] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:43.133322 7463 raft_consensus.cc:729] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3f94b4d6814e45ab81a44e7e671389, State: Initialized, Role: FOLLOWER
I20260811 01:03:43.133426 7468 log.cc:824] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Log is configured to *not* fsync() on all Append() calls
I20260811 01:03:43.133534 7463 consensus_queue.cc:260] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:03:43.133886 7463 ts_tablet_manager.cc:1428] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 01:03:43.134032 7431 heartbeater.cc:503] Master 127.13.30.190:35391 was elected leader, sending a full tablet report...
I20260811 01:03:43.133842 7461 raft_consensus.cc:348] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:03:43.134107 7461 raft_consensus.cc:374] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:43.134155 7461 raft_consensus.cc:729] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1f3b428c8a7451197a3e54a1c1bab79, State: Initialized, Role: FOLLOWER
I20260811 01:03:43.134316 7461 consensus_queue.cc:260] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:03:43.134639 7468 tablet_bootstrap.cc:492] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: No bootstrap required, opened a new log
I20260811 01:03:43.134699 7461 ts_tablet_manager.cc:1428] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:03:43.134742 7468 ts_tablet_manager.cc:1397] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 01:03:43.134883 7234 heartbeater.cc:503] Master 127.13.30.190:35391 was elected leader, sending a full tablet report...
I20260811 01:03:43.136550 7468 raft_consensus.cc:348] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:03:43.136744 7468 raft_consensus.cc:374] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:03:43.136770 7468 raft_consensus.cc:729] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd7f7c369f604f18a121656d20e59ed7, State: Initialized, Role: FOLLOWER
I20260811 01:03:43.136878 7468 consensus_queue.cc:260] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:03:43.137162 7468 ts_tablet_manager.cc:1428] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 01:03:43.137207 7040 heartbeater.cc:503] Master 127.13.30.190:35391 was elected leader, sending a full tablet report...
W20260811 01:03:43.165292 7235 tablet.cc:2369] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:03:43.249679 7473 raft_consensus.cc:482] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:03:43.249859 7473 raft_consensus.cc:504] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:03:43.250291 7473 leader_election.cc:288] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135), fd7f7c369f604f18a121656d20e59ed7 (127.13.30.129:40519)
I20260811 01:03:43.253127 7458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.250672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:34625 (local address 127.13.30.129:40519)
0811 01:03:43.250737 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:43.250739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:43.250747 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:03:43.250778 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:43.250779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:43.250789 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:43.250841 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:43.251002 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.251481 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.252409 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.252785 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.252854 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:43.252864 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:43.253007 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 01:03:43.253049 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 01:03:43.253127 7236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.250568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40519 (local address 127.13.30.130:34625)
0811 01:03:43.250636 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:43.250648 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:43.250695 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:43.250857 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:43.250858 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:43.250859 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:43.250937 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:43.250939 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.251562 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.251564 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:43.252316 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:43.252318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.252861 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.252862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:43.252944 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:43.252947 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:03:43.252996 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 01:03:43.253045 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 01:03:43.253202 7459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.250645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:58449 (local address 127.13.30.131:38135)
0811 01:03:43.250698 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:43.250700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:43.250857 (+ 157us) server_negotiation.cc:407] Connection header received
0811 01:03:43.250907 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:43.250908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:43.250919 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:43.250962 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:03:43.251116 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.251588 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.252504 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.252875 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.252939 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:43.252949 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:43.253087 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 01:03:43.253127 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 01:03:43.253482 7475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.250574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:38135 (local address 127.13.30.130:58449)
0811 01:03:43.250774 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:43.250784 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:03:43.250848 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:03:43.250980 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:03:43.250981 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:03:43.250982 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:03:43.251057 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:43.251059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.251668 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.251669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:43.252419 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:03:43.252421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.252964 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.252964 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:03:43.253027 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:43.253031 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:03:43.253075 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 01:03:43.253116 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":19,"thread_start_us":113,"threads_started":1}
I20260811 01:03:43.253585 6969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31ecd0c497a04b55b46d0791f259b445" candidate_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd7f7c369f604f18a121656d20e59ed7" is_pre_election: true
I20260811 01:03:43.253816 6969 raft_consensus.cc:2454] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1f3b428c8a7451197a3e54a1c1bab79 in term 0.
I20260811 01:03:43.253841 7359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31ecd0c497a04b55b46d0791f259b445" candidate_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3f94b4d6814e45ab81a44e7e671389" is_pre_election: true
I20260811 01:03:43.254027 7359 raft_consensus.cc:2454] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1f3b428c8a7451197a3e54a1c1bab79 in term 0.
I20260811 01:03:43.254084 7075 leader_election.cc:302] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1f3b428c8a7451197a3e54a1c1bab79, fd7f7c369f604f18a121656d20e59ed7; no voters:
I20260811 01:03:43.254230 7473 raft_consensus.cc:2781] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:03:43.254292 7473 raft_consensus.cc:482] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:03:43.254321 7473 raft_consensus.cc:3037] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:43.255108 7473 raft_consensus.cc:504] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:03:43.255270 7473 leader_election.cc:288] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [CANDIDATE]: Term 1 election: Requested vote from peers dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135), fd7f7c369f604f18a121656d20e59ed7 (127.13.30.129:40519)
I20260811 01:03:43.255458 7359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31ecd0c497a04b55b46d0791f259b445" candidate_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3f94b4d6814e45ab81a44e7e671389"
I20260811 01:03:43.255505 6969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31ecd0c497a04b55b46d0791f259b445" candidate_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd7f7c369f604f18a121656d20e59ed7"
I20260811 01:03:43.255548 7359 raft_consensus.cc:3037] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:03:43.255577 6969 raft_consensus.cc:3037] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7 [term 0 FOLLOWER]: Advancing to term 1
W20260811 01:03:43.256098 7041 tablet.cc:2369] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:03:43.256500 7359 raft_consensus.cc:2454] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1f3b428c8a7451197a3e54a1c1bab79 in term 1.
I20260811 01:03:43.256500 6969 raft_consensus.cc:2454] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1f3b428c8a7451197a3e54a1c1bab79 in term 1.
I20260811 01:03:43.256677 7075 leader_election.cc:302] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1f3b428c8a7451197a3e54a1c1bab79, fd7f7c369f604f18a121656d20e59ed7; no voters:
I20260811 01:03:43.256762 7473 raft_consensus.cc:2781] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:03:43.256933 7473 raft_consensus.cc:686] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [term 1 LEADER]: Becoming Leader. State: Replica: a1f3b428c8a7451197a3e54a1c1bab79, State: Running, Role: LEADER
I20260811 01:03:43.257030 7473 consensus_queue.cc:237] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:03:43.257961 6737 catalog_manager.cc:5495] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130). New cstate: current_term: 1 leader_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } health_report { overall_health: UNKNOWN } } }
I20260811 01:03:43.271232 7455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.268722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55440 (local address 127.13.30.130:43009)
0811 01:03:43.268779 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 01:03:43.268781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:03:43.268795 (+ 14us) server_negotiation.cc:407] Connection header received
0811 01:03:43.268840 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:03:43.268841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:03:43.268863 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:03:43.268928 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:03:43.269066 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.269621 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.270420 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:03:43.270636 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:03:43.270694 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:03:43.270857 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:03:43.270981 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:03:43.271061 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 01:03:43.271088 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 01:03:43.271115 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 01:03:43.273955 7359 raft_consensus.cc:1261] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389 [term 1 FOLLOWER]: Refusing update from remote peer a1f3b428c8a7451197a3e54a1c1bab79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:03:43.273955 6969 raft_consensus.cc:1261] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Refusing update from remote peer a1f3b428c8a7451197a3e54a1c1bab79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:03:43.274319 7473 consensus_queue.cc:1035] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:03:43.274471 7476 consensus_queue.cc:1035] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:03:43.277187 7481 mvcc.cc:205] Tried to move back new op lower bound from 7317136274526744576 to 7317136274461356032. Current Snapshot: MvccSnapshot[applied={T|T < 7317136274526744576}]
I20260811 01:03:43.277897 7483 mvcc.cc:205] Tried to move back new op lower bound from 7317136274526744576 to 7317136274461356032. Current Snapshot: MvccSnapshot[applied={T|T < 7317136274526744576}]
I20260811 01:03:43.280084 6737 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:03:43.280210 6737 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:03:43.281018 6737 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Sending DeleteTablet for 3 replicas of tablet 31ecd0c497a04b55b46d0791f259b445
I20260811 01:03:43.281368 7143 tablet_service.cc:1514] Processing DeleteTablet for tablet 31ecd0c497a04b55b46d0791f259b445 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:03:43 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:55434
I20260811 01:03:43.281405 7335 tablet_service.cc:1514] Processing DeleteTablet for tablet 31ecd0c497a04b55b46d0791f259b445 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:03:43 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:39788
I20260811 01:03:43.281672 7497 tablet_replica.cc:330] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79: stopping tablet replica
I20260811 01:03:43.281683 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 6838
I20260811 01:03:43.281775 7497 raft_consensus.cc:2229] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:03:43.281909 7497 raft_consensus.cc:2258] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:03:43.282469 7497 ts_tablet_manager.cc:1905] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:03:43.284533 7497 ts_tablet_manager.cc:1918] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:03:43.284626 7497 log.cc:1196] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/31ecd0c497a04b55b46d0791f259b445
I20260811 01:03:43.284934 7497 ts_tablet_manager.cc:1939] T 31ecd0c497a04b55b46d0791f259b445 P a1f3b428c8a7451197a3e54a1c1bab79: Deleting consensus metadata
I20260811 01:03:43.285535 7496 tablet_replica.cc:330] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389: stopping tablet replica
I20260811 01:03:43.285566 6716 catalog_manager.cc:4841] TS a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009): tablet 31ecd0c497a04b55b46d0791f259b445 (table test-table [id=ee5ad284109d4c4e814b4f1f227f5d89]) successfully deleted
I20260811 01:03:43.285702 7496 raft_consensus.cc:2229] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:03:43.285866 7496 raft_consensus.cc:2258] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:03:43.286442 7496 ts_tablet_manager.cc:1905] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:03:43.288327 7496 ts_tablet_manager.cc:1918] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:03:43.288431 7496 log.cc:1196] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/31ecd0c497a04b55b46d0791f259b445
I20260811 01:03:43.288785 7496 ts_tablet_manager.cc:1939] T 31ecd0c497a04b55b46d0791f259b445 P dc3f94b4d6814e45ab81a44e7e671389: Deleting consensus metadata
I20260811 01:03:43.289359 6713 catalog_manager.cc:4841] TS dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135): tablet 31ecd0c497a04b55b46d0791f259b445 (table test-table [id=ee5ad284109d4c4e814b4f1f227f5d89]) successfully deleted
W20260811 01:03:43.334194 6718 connection.cc:535] client connection to 127.13.30.129:40519 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 01:03:43.334324 6718 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 01:03:43.334380 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 7046
I20260811 01:03:43.337910 7447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.337646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40519 (local address 127.0.0.1:49642)
0811 01:03:43.337824 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:43.337863 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:40519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157}
W20260811 01:03:43.338052 6718 catalog_manager.cc:4584] TS fd7f7c369f604f18a121656d20e59ed7 (127.13.30.129:40519): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 31ecd0c497a04b55b46d0791f259b445: Network error: Client connection negotiation failed: client connection to 127.13.30.129:40519: connect: Connection refused (error 111)
I20260811 01:03:43.351877 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 7241
I20260811 01:03:43.405426 7447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.405234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40519 (local address 127.0.0.1:49650)
0811 01:03:43.405310 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:43.405373 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:40519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 01:03:43.405865 7447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:03:43.405765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40519 (local address 127.0.0.1:49664)
0811 01:03:43.405808 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 01:03:43.405841 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:40519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 01:03:43.409646 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 6682
I20260811 01:04:03.428117 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:35391
--webserver_interface=127.13.30.190
--webserver_port=33103
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:37693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:35391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:03.517048 7500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:03.517309 7500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:03.517335 7500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:03.518812 7500 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 01:04:03.518875 7500 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 01:04:03.518889 7500 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 01:04:03.518900 7500 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:04:03.518913 7500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:03.518924 7500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:03.518935 7500 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:04:03.518947 7500 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:04:03.520836 7500 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:37693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:35391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:35391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=33103
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:03.521137 7500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:03.521404 7500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:03.532585 7512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:03.532549 7513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:03.532524 7515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:03.532601 7500 server_base.cc:1034] running on GCE node
I20260811 01:04:03.533304 7500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:03.533702 7500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:03.534861 7500 hybrid_clock.cc:648] HybridClock initialized: now 1786410243534835 us; error 56 us; skew 500 ppm
Aug 11 01:04:03 dist-test-slave-42z9 krb5kdc[6662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410243, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:03.540786 7500 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:04:03.541347 7500 webserver.cc:460] Webserver started at http://127.13.30.190:33103/ using document root <none> and password file <none>
I20260811 01:04:03.541646 7500 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:03.541725 7500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:03.543349 7500 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:03.544142 7527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:03.544523 7500 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:03.544764 7500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "b45e327162abdef701779524dc4ad7c7"
server_key_iv: "70c5587fde7a3194c6b3f9ca553490fa"
server_key_version: "encryptionkey@0"
I20260811 01:04:03.545394 7500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:03.567137 7500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:03.569415 7500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:03.569604 7500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:03.575167 7500 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:35391
I20260811 01:04:03.575208 7613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:35391 every 8 connection(s)
I20260811 01:04:03.575690 7500 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:04:03.577329 7614 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:04:03.578078 7614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Bootstrap starting.
I20260811 01:04:03.585700 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 7500
I20260811 01:04:03.586098 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:40519
--local_ip_for_outbound_sockets=127.13.30.129
--tserver_master_addrs=127.13.30.190:35391
--webserver_port=44087
--webserver_interface=127.13.30.129
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:37693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:04:03.587327 7614 log.cc:824] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:03.589529 7614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:04:03.589833 7614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Bootstrap complete.
I20260811 01:04:03.592212 7614 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } }
I20260811 01:04:03.592461 7614 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93ca4f60d5bd4e2c909fe86310d4ddfa, State: Initialized, Role: FOLLOWER
I20260811 01:04:03.592623 7614 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } }
I20260811 01:04:03.592701 7614 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:04:03.592760 7614 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:04:03.592810 7614 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:04:03.594002 7614 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } }
I20260811 01:04:03.594113 7614 leader_election.cc:302] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93ca4f60d5bd4e2c909fe86310d4ddfa; no voters:
I20260811 01:04:03.594287 7614 leader_election.cc:288] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 01:04:03.594341 7622 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:04:03.594511 7622 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 2 LEADER]: Becoming Leader. State: Replica: 93ca4f60d5bd4e2c909fe86310d4ddfa, State: Running, Role: LEADER
I20260811 01:04:03.594600 7614 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:04:03.594630 7622 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } }
I20260811 01:04:03.595024 7623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } } }
I20260811 01:04:03.595103 7623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:03.595398 7624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93ca4f60d5bd4e2c909fe86310d4ddfa. Latest consensus state: current_term: 2 leader_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } } }
I20260811 01:04:03.595458 7624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:03.597237 7650 catalog_manager.cc:1259] Loaded cluster ID: bd97ef02b87c44afbe44f8e5301c0729
I20260811 01:04:03.597296 7650 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: loading cluster ID for follower catalog manager: success
I20260811 01:04:03.598520 7650 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: acquiring CA information for follower catalog manager: success
I20260811 01:04:03.599014 7650 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:04:03.599107 7631 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:04:03.599568 7631 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:04:03.599660 7631 catalog_manager.cc:1259] Loaded cluster ID: bd97ef02b87c44afbe44f8e5301c0729
I20260811 01:04:03.599689 7631 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:04:03.599838 7631 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:04:03.599910 7631 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Loaded TSK: 0
I20260811 01:04:03.610498 7631 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Generated new TSK 1
I20260811 01:04:03.610630 7631 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:04:03.677491 7621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:03.677733 7621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:03.677768 7621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:03.679037 7621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:03.679087 7621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:03.679126 7621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:04:03.680763 7621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:37693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:40519
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=44087
--tserver_master_addrs=127.13.30.190:35391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:03.681030 7621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:03.681277 7621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:03.687721 7662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:03.687704 7663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:03.687704 7668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:03.688081 7621 server_base.cc:1034] running on GCE node
I20260811 01:04:03.688275 7621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:03.688532 7621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:03.689702 7621 hybrid_clock.cc:648] HybridClock initialized: now 1786410243689686 us; error 33 us; skew 500 ppm
Aug 11 01:04:03 dist-test-slave-42z9 krb5kdc[6662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410243, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:03.692483 7621 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:04:03.692934 7621 webserver.cc:460] Webserver started at http://127.13.30.129:44087/ using document root <none> and password file <none>
I20260811 01:04:03.693142 7621 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:03.693210 7621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:03.694782 7621 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:03.695520 7676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:03.695715 7621 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:03.695809 7621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "fd7f7c369f604f18a121656d20e59ed7"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "b27a8253c6e51b59a429b6399e9711cb"
server_key_iv: "3a715c272f9ef7b5172df2e7c06b8546"
server_key_version: "encryptionkey@0"
I20260811 01:04:03.696218 7621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:03.710079 7621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:03.712296 7621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:03.712453 7621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:03.712724 7621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:03.713197 7684 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 01:04:03.715329 7621 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 01:04:03.715399 7621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 01:04:03.715440 7621 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 01:04:03.716116 7621 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 01:04:03.716151 7621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 01:04:03.716241 7684 tablet_bootstrap.cc:492] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Bootstrap starting.
I20260811 01:04:03.723352 7621 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:40519
I20260811 01:04:03.723449 7856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:40519 every 8 connection(s)
I20260811 01:04:03.723850 7621 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:04:03.728490 7684 log.cc:824] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:03.731691 7684 tablet_bootstrap.cc:492] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:04:03.732070 7684 tablet_bootstrap.cc:492] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Bootstrap complete.
I20260811 01:04:03.733109 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 7621
I20260811 01:04:03.733364 7684 ts_tablet_manager.cc:1397] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.011s
I20260811 01:04:03.733855 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:43009
--local_ip_for_outbound_sockets=127.13.30.130
--tserver_master_addrs=127.13.30.190:35391
--webserver_port=33751
--webserver_interface=127.13.30.130
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:37693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:04:03.735035 7684 raft_consensus.cc:348] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:03.735360 7684 raft_consensus.cc:729] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd7f7c369f604f18a121656d20e59ed7, State: Initialized, Role: FOLLOWER
I20260811 01:04:03.735540 7684 consensus_queue.cc:260] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:03.735853 7684 ts_tablet_manager.cc:1428] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Time spent starting tablet: real 0.002s user 0.006s sys 0.000s
Aug 11 01:04:03 dist-test-slave-42z9 krb5kdc[6662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410243, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:04:03.741158 7860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:03.725000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:41065)
0811 01:04:03.728856 (+ 3856us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:03.728930 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:03.729785 (+ 855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:03.730311 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:03.730316 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:03.730794 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:03.731085 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:03.731094 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:03.732566 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:03.732567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:03.734309 (+ 1742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:03.734343 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:03.735418 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:03.735419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:03.735562 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:03.736179 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:04:03.736192 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:03.737724 (+ 1532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:03.739505 (+ 1781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:03.739513 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:03.739515 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:03.739745 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:03.740033 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:03.740034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:03.740035 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:03.740138 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:03.740526 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:03.740533 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:03.740658 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 01:04:03.740744 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 01:04:03.740944 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3788,"thread_start_us":216,"threads_started":1}
I20260811 01:04:03.741156 7861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:03.725136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:41065 (local address 127.13.30.190:35391)
0811 01:04:03.728949 (+ 3813us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:03.728961 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:03.729108 (+ 147us) server_negotiation.cc:407] Connection header received
0811 01:04:03.730059 (+ 951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:03.730065 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:03.730118 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:03.730262 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:03.731274 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:03.732436 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:03.734523 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:03.735162 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:03.735289 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:03.737861 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:03.737866 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:03.737866 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:03.737877 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:03.739419 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:03.739860 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:03.739863 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:03.739864 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:03.739967 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:03.740209 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:03.740210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:03.740210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:03.740459 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:03.740533 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:03.740835 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 01:04:03.740968 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3733,"thread_start_us":104,"threads_started":1}
I20260811 01:04:03.742359 7857 heartbeater.cc:347] Connected to a master server at 127.13.30.190:35391
I20260811 01:04:03.742465 7857 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:03.742650 7857 heartbeater.cc:511] Master 127.13.30.190:35391 requested a full tablet report, sending...
I20260811 01:04:03.743340 7559 ts_manager.cc:194] Registered new tserver with Master: fd7f7c369f604f18a121656d20e59ed7 (127.13.30.129:40519)
I20260811 01:04:03.744405 7559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:41065
I20260811 01:04:03.745433 7857 heartbeater.cc:503] Master 127.13.30.190:35391 was elected leader, sending a full tablet report...
I20260811 01:04:03.748406 7867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:03.744691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49730 (local address 127.13.30.129:40519)
0811 01:04:03.744886 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:03.744891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:03.745137 (+ 246us) server_negotiation.cc:407] Connection header received
0811 01:04:03.745181 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:03.745184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:03.745244 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:03.745308 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:03.745547 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:03.746483 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:03.747483 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:03.747996 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:03.748063 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:03.748123 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:03.748288 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 01:04:03.748334 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":95,"threads_started":1}
I20260811 01:04:03.748406 7866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:03.743926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40519 (local address 127.0.0.1:49730)
0811 01:04:03.744955 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:03.744992 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:03.745064 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:03.745371 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:03.745374 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:03.745376 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:03.745471 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:03.745474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:03.746563 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:03.746564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:03.747397 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:03.747399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:03.748073 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:03.748074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:03.748180 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:03.748195 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 01:04:03.748257 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 01:04:03.748327 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1000,"thread_start_us":111,"threads_started":1}
I20260811 01:04:03.749058 7751 tablet_service.cc:1514] Processing DeleteTablet for tablet 31ecd0c497a04b55b46d0791f259b445 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:03:43 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:49730
I20260811 01:04:03.749665 7868 tablet_replica.cc:330] stopping tablet replica
I20260811 01:04:03.749841 7868 raft_consensus.cc:2229] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:03.749917 7868 raft_consensus.cc:2258] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:03.750288 7868 ts_tablet_manager.cc:1905] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:03.752334 7868 ts_tablet_manager.cc:1918] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:03.752413 7868 log.cc:1196] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal/wals/31ecd0c497a04b55b46d0791f259b445
I20260811 01:04:03.752651 7868 ts_tablet_manager.cc:1939] T 31ecd0c497a04b55b46d0791f259b445 P fd7f7c369f604f18a121656d20e59ed7: Deleting consensus metadata
I20260811 01:04:03.753185 7536 catalog_manager.cc:4841] TS fd7f7c369f604f18a121656d20e59ed7 (127.13.30.129:40519): tablet 31ecd0c497a04b55b46d0791f259b445 (table test-table [id=ee5ad284109d4c4e814b4f1f227f5d89]) successfully deleted
W20260811 01:04:03.824653 7863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:03.824882 7863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:03.824908 7863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:03.826221 7863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:03.826273 7863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:03.826301 7863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:04:03.827863 7863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:37693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:43009
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=33751
--tserver_master_addrs=127.13.30.190:35391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:03.828119 7863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:03.828356 7863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:03.833794 7882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:03.833997 7878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:03.833892 7885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:03.834136 7863 server_base.cc:1034] running on GCE node
I20260811 01:04:03.834494 7863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:03.834761 7863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:03.835932 7863 hybrid_clock.cc:648] HybridClock initialized: now 1786410243835918 us; error 38 us; skew 500 ppm
Aug 11 01:04:03 dist-test-slave-42z9 krb5kdc[6662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410243, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:03.838680 7863 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:04:03.839110 7863 webserver.cc:460] Webserver started at http://127.13.30.130:33751/ using document root <none> and password file <none>
I20260811 01:04:03.839367 7863 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:03.839435 7863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:03.840976 7863 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:03.841979 7896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:03.842247 7863 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:03.842361 7863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "a1f3b428c8a7451197a3e54a1c1bab79"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "6e5b3a0f61437bc5f6a512a0ca9aaad0"
server_key_iv: "efa402a338577517eb5e8bfa013f3516"
server_key_version: "encryptionkey@0"
I20260811 01:04:03.842748 7863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:03.855213 7863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:03.857616 7863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:03.857754 7863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:03.857981 7863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:03.858290 7863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:03.858325 7863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:03.858347 7863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:03.858371 7863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:03.864063 7863 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:43009
I20260811 01:04:03.864148 8074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:43009 every 8 connection(s)
I20260811 01:04:03.864483 7863 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
Aug 11 01:04:03 dist-test-slave-42z9 krb5kdc[6662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410243, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:04:03.872251 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 7863
I20260811 01:04:03.872591 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:38135
--local_ip_for_outbound_sockets=127.13.30.131
--tserver_master_addrs=127.13.30.190:35391
--webserver_port=45445
--webserver_interface=127.13.30.131
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:37693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:04:03.874857 7861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:03.865245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:54951 (local address 127.13.30.190:35391)
0811 01:04:03.865296 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:03.865299 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:03.865537 (+ 238us) server_negotiation.cc:407] Connection header received
0811 01:04:03.866048 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:03.866049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:03.866060 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:03.866114 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:03.867085 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:03.867595 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:03.868651 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:03.868930 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:03.869039 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:03.871763 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:03.871766 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:03.871766 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:03.871776 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:03.873245 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:03.873770 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:03.873771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:03.873772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:03.873846 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:03.874111 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:03.874112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:03.874112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:03.874227 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:03.874273 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:03.874649 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 01:04:03.874763 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 01:04:03.874941 8077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:03.865216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:54951)
0811 01:04:03.865389 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:03.865427 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:03.865963 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:03.866173 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:03.866176 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:03.866783 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:03.867008 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:03.867013 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:03.867668 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:03.867669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:03.868480 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:03.868485 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:03.869049 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:03.869050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:03.869158 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:03.869838 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:04:03.869852 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:03.871639 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:03.873338 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:03.873348 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:03.873351 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:03.873691 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:03.873912 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:03.873913 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:03.873913 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:03.874055 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:03.874276 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:03.874282 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:03.874468 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 01:04:03.874584 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 01:04:03.874739 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
I20260811 01:04:03.875432 8075 heartbeater.cc:347] Connected to a master server at 127.13.30.190:35391
I20260811 01:04:03.875530 8075 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:03.875731 8075 heartbeater.cc:511] Master 127.13.30.190:35391 requested a full tablet report, sending...
I20260811 01:04:03.876118 7559 ts_manager.cc:194] Registered new tserver with Master: a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009)
I20260811 01:04:03.876500 7559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:54951
W20260811 01:04:03.958770 8078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:03.959020 8078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:03.959055 8078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:03.960320 8078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:03.960366 8078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:03.960403 8078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:04:03.962067 8078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:37693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:38135
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=45445
--tserver_master_addrs=127.13.30.190:35391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:03.962337 8078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:03.962572 8078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:03.967908 8088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:03.967911 8090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:03.967908 8092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:03.968400 8078 server_base.cc:1034] running on GCE node
I20260811 01:04:03.968708 8078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:03.969043 8078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:03.970238 8078 hybrid_clock.cc:648] HybridClock initialized: now 1786410243970229 us; error 35 us; skew 500 ppm
Aug 11 01:04:03 dist-test-slave-42z9 krb5kdc[6662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410243, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:03.973397 8078 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:04:03.974001 8078 webserver.cc:460] Webserver started at http://127.13.30.131:45445/ using document root <none> and password file <none>
I20260811 01:04:03.974239 8078 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:03.974311 8078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:03.975816 8078 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:03.976480 8104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:03.976655 8078 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:03.976752 8078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "dc3f94b4d6814e45ab81a44e7e671389"
format_stamp: "Formatted at 2026-08-11 01:03:43 on dist-test-slave-42z9"
server_key: "db278623ed81d742fca3881f7c394973"
server_key_iv: "b783d1fa6bae55fb457ce08754ec42aa"
server_key_version: "encryptionkey@0"
I20260811 01:04:03.977118 8078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:03.988235 8078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:03.990664 8078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:03.990813 8078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:03.991052 8078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:03.991365 8078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:03.991400 8078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:03.991428 8078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:03.991453 8078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:03.997546 8078 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:38135
I20260811 01:04:03.997599 8274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:38135 every 8 connection(s)
I20260811 01:04:03.997956 8078 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:04:03.999650 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 8078
Aug 11 01:04:04 dist-test-slave-42z9 krb5kdc[6662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410243, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:04:04.008178 8282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:04.000070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44038 (local address 127.13.30.190:35391)
0811 01:04:04.000213 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:04.000214 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:04.000275 (+ 61us) server_negotiation.cc:407] Connection header received
0811 01:04:04.000358 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:04.000359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:04.000369 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:04.000424 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:04.001209 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.002361 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.003568 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.003884 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.003949 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:04.005344 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:04.005346 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:04.005347 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:04.005354 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:04.006929 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:04.007317 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:04.007318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:04.007319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:04.007382 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:04.007597 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:04.007598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:04.007598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:04.007743 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:04.007947 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:04.007986 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 01:04:04.008065 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":97,"thread_start_us":65,"threads_started":1}
I20260811 01:04:04.009342 7861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:03.998771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:50587 (local address 127.13.30.190:35391)
0811 01:04:03.998845 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:03.998847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:03.999089 (+ 242us) server_negotiation.cc:407] Connection header received
0811 01:04:03.999701 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:03.999702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:03.999715 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:03.999785 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:04.001208 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.002361 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.003901 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.004193 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.004269 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:04.006617 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:04.006618 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:04.006619 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:04.006626 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:04.007931 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:04.008387 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:04.008389 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:04.008390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:04.008476 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:04.008733 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:04.008733 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:04.008734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:04.008847 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:04.008905 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:04.009209 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 01:04:04.009281 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":39}
I20260811 01:04:04.009593 8279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:03.998777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:50587)
0811 01:04:03.998963 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:03.999002 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:03.999588 (+ 586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:03.999883 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:03.999887 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:04.000708 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:04.001023 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:04.001031 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.002514 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.002515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:04.003804 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:04.003807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.004297 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.004299 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:04.004457 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:04.004928 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:04:04.004938 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:04.006527 (+ 1589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:04.008017 (+ 1490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:04.008025 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:04.008028 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:04.008282 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:04.008529 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:04.008530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:04.008531 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:04.008674 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:04.008932 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:04.008940 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:04.009088 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 01:04:04.009179 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 01:04:04.009319 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":90,"threads_started":1}
I20260811 01:04:04.010010 8275 heartbeater.cc:347] Connected to a master server at 127.13.30.190:35391
I20260811 01:04:04.010113 8275 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:04.010301 8275 heartbeater.cc:511] Master 127.13.30.190:35391 requested a full tablet report, sending...
I20260811 01:04:04.010679 7559 ts_manager.cc:194] Registered new tserver with Master: dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135)
I20260811 01:04:04.011018 7559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:50587
I20260811 01:04:04.020402 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:04:04.023276 7861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:04.020867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44052 (local address 127.13.30.190:35391)
0811 01:04:04.020930 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:04.020932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:04.020961 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:04:04.021036 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:04.021036 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:04.021076 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:04.021137 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:04:04.021271 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.021809 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.022642 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.022839 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.022904 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:04.023046 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:04:04.023096 (+ 50us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 01:04:04.023218 (+ 122us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44052: token expired
Metrics: {"server-negotiator.queue_time_us":39}
W20260811 01:04:04.023356 7861 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44052: token expired
W20260811 01:04:04.023594 7438 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.13.30.190:35391)
I20260811 01:04:04.030208 7861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:04.023853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44066 (local address 127.13.30.190:35391)
0811 01:04:04.023889 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:04.023891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:04.023898 (+ 7us) server_negotiation.cc:407] Connection header received
0811 01:04:04.023966 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:04.023967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:04.023977 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:04.024021 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:04.024521 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.024974 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.025680 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.025863 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.025917 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:04.027418 (+ 1501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:04.027420 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:04.027421 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:04.027430 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:04.028893 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:04.029315 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:04.029317 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:04.029317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:04.029376 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:04.029618 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:04.029620 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:04.029620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:04.029789 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:04.029890 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:04.030024 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 01:04:04.030111 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 01:04:04.031605 7559 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44066:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:04:04.033470 7559 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:04:04.035863 7751 tablet_service.cc:1467] Processing CreateTablet for tablet e89a10b1cdb8497f9c856b550c4676ec (DEFAULT_TABLE table=test-table [id=0a89aedde8a84b7bbd33154d47c7621c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:04.036083 7751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89a10b1cdb8497f9c856b550c4676ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:04.037827 7684 tablet_bootstrap.cc:492] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7: Bootstrap starting.
I20260811 01:04:04.038188 7684 tablet_bootstrap.cc:654] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:04.038722 7684 tablet_bootstrap.cc:492] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7: No bootstrap required, opened a new log
I20260811 01:04:04.038766 7684 ts_tablet_manager.cc:1397] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:04.038861 7684 raft_consensus.cc:348] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:04.038911 7684 raft_consensus.cc:374] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:04.038941 7684 raft_consensus.cc:729] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd7f7c369f604f18a121656d20e59ed7, State: Initialized, Role: FOLLOWER
I20260811 01:04:04.038981 7684 consensus_queue.cc:260] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:04.039070 7684 ts_tablet_manager.cc:1428] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:04.039655 7866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:04.035640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:43009 (local address 127.0.0.1:51590)
0811 01:04:04.035694 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:04.035707 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:04.035747 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:04.036407 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:04.036408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:04.036410 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:04.036467 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:04.036469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.037535 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.037536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:04.038473 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:04.038478 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.039417 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.039418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:04.039481 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:04.039484 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:04:04.039532 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 01:04:04.039583 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 01:04:04.039896 8288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:04.036032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51590 (local address 127.13.30.130:43009)
0811 01:04:04.036213 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:04.036217 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:04.036229 (+ 12us) server_negotiation.cc:407] Connection header received
0811 01:04:04.036284 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:04.036286 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:04.036303 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:04.036399 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:04.036619 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.037427 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.038570 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.039341 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.039406 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:04.039471 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:04.039765 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 01:04:04.039812 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":100,"threads_started":1}
I20260811 01:04:04.040351 8289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:04.035640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:38135 (local address 127.0.0.1:33136)
0811 01:04:04.036348 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:04.036359 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:04.036463 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:04.036725 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:04.036726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:04.036729 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:04.036768 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:04.036769 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.038094 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.038095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:04.039105 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:04.039108 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.040071 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.040072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:04.040137 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:04.040141 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:04:04.040222 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 01:04:04.040271 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"mutex_wait_us":545,"thread_start_us":91,"threads_started":1}
I20260811 01:04:04.040390 8287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:04.035804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33136 (local address 127.13.30.131:38135)
0811 01:04:04.036025 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:04.036030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:04.036433 (+ 403us) server_negotiation.cc:407] Connection header received
0811 01:04:04.036541 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:04.036544 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:04.036561 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:04.036633 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:04.036852 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.038005 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.039186 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.039912 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.039975 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:04.040035 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:04.040251 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 01:04:04.040303 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":114,"threads_started":1}
I20260811 01:04:04.040656 7968 tablet_service.cc:1467] Processing CreateTablet for tablet e89a10b1cdb8497f9c856b550c4676ec (DEFAULT_TABLE table=test-table [id=0a89aedde8a84b7bbd33154d47c7621c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:04.040963 7968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89a10b1cdb8497f9c856b550c4676ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:04.043776 8294 tablet_bootstrap.cc:492] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79: Bootstrap starting.
I20260811 01:04:04.044586 8294 tablet_bootstrap.cc:654] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:04.044539 8174 tablet_service.cc:1467] Processing CreateTablet for tablet e89a10b1cdb8497f9c856b550c4676ec (DEFAULT_TABLE table=test-table [id=0a89aedde8a84b7bbd33154d47c7621c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:04.044862 8174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89a10b1cdb8497f9c856b550c4676ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:04.045076 8294 log.cc:824] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:04.045965 8294 tablet_bootstrap.cc:492] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79: No bootstrap required, opened a new log
I20260811 01:04:04.046041 8294 ts_tablet_manager.cc:1397] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:04:04.047605 8294 raft_consensus.cc:348] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:04.047760 8294 raft_consensus.cc:374] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:04.047791 8294 raft_consensus.cc:729] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1f3b428c8a7451197a3e54a1c1bab79, State: Initialized, Role: FOLLOWER
I20260811 01:04:04.047904 8294 consensus_queue.cc:260] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:04.048051 8296 tablet_bootstrap.cc:492] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389: Bootstrap starting.
I20260811 01:04:04.048213 8294 ts_tablet_manager.cc:1428] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 01:04:04.048272 8075 heartbeater.cc:503] Master 127.13.30.190:35391 was elected leader, sending a full tablet report...
I20260811 01:04:04.048728 8296 tablet_bootstrap.cc:654] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:04.049378 8296 log.cc:824] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:04.050149 8296 tablet_bootstrap.cc:492] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389: No bootstrap required, opened a new log
I20260811 01:04:04.050212 8296 ts_tablet_manager.cc:1397] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:04:04.051589 8296 raft_consensus.cc:348] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:04.051741 8296 raft_consensus.cc:374] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:04.051764 8296 raft_consensus.cc:729] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3f94b4d6814e45ab81a44e7e671389, State: Initialized, Role: FOLLOWER
I20260811 01:04:04.051867 8296 consensus_queue.cc:260] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:04.052217 8296 ts_tablet_manager.cc:1428] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:04:04.052304 8275 heartbeater.cc:503] Master 127.13.30.190:35391 was elected leader, sending a full tablet report...
W20260811 01:04:04.115078 8076 tablet.cc:2369] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:04:04.229185 7859 tablet.cc:2369] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:04:04.248857 8278 tablet.cc:2369] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:04:04.331075 7864 raft_consensus.cc:482] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:04:04.331231 7864 raft_consensus.cc:504] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:04.331620 7864 leader_election.cc:288] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009), dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135)
I20260811 01:04:04.334631 8287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:04.332014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:60049 (local address 127.13.30.131:38135)
0811 01:04:04.332059 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:04.332060 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:04.332069 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:04:04.332120 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:04.332121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:04.332130 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:04.332181 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:04.332315 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.332798 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.333890 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.334297 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.334367 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:04.334378 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:04.334519 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 01:04:04.334560 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 01:04:04.334630 8288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:04.331922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:42273 (local address 127.13.30.130:43009)
0811 01:04:04.331980 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:04.331983 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:04.332030 (+ 47us) server_negotiation.cc:407] Connection header received
0811 01:04:04.332103 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:04.332104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:04.332118 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:04.332166 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:04.332293 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.332779 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.333899 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.334297 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.334367 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:04.334378 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:04.334509 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 01:04:04.334548 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 01:04:04.334679 8302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:04.331817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:43009 (local address 127.13.30.129:42273)
0811 01:04:04.331973 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:04.331984 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:04.332050 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:04.332171 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:04.332172 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:04.332174 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:04.332235 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:04.332237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.332868 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.332869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:04.333806 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:04.333809 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.334381 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.334382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:04.334448 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:04.334452 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:04:04.334498 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:04:04.334549 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":57,"thread_start_us":73,"threads_started":1}
I20260811 01:04:04.334689 8300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:04.331815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:38135 (local address 127.13.30.129:60049)
0811 01:04:04.331958 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:04.331972 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:04.332055 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:04.332193 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:04.332194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:04.332197 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:04.332257 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:04.332259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.332882 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.332883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:04.333799 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:04.333802 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.334387 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.334388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:04.334445 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:04.334449 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:04:04.334496 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 01:04:04.334552 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":36,"spinlock_wait_cycles":14208,"thread_start_us":87,"threads_started":1}
I20260811 01:04:04.335072 8005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e89a10b1cdb8497f9c856b550c4676ec" candidate_uuid: "fd7f7c369f604f18a121656d20e59ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" is_pre_election: true
I20260811 01:04:04.335263 8005 raft_consensus.cc:2454] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd7f7c369f604f18a121656d20e59ed7 in term 0.
I20260811 01:04:04.335230 8206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e89a10b1cdb8497f9c856b550c4676ec" candidate_uuid: "fd7f7c369f604f18a121656d20e59ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3f94b4d6814e45ab81a44e7e671389" is_pre_election: true
I20260811 01:04:04.335355 8206 raft_consensus.cc:2454] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd7f7c369f604f18a121656d20e59ed7 in term 0.
I20260811 01:04:04.335527 7680 leader_election.cc:302] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1f3b428c8a7451197a3e54a1c1bab79, fd7f7c369f604f18a121656d20e59ed7; no voters:
I20260811 01:04:04.335677 7864 raft_consensus.cc:2781] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:04:04.335743 7864 raft_consensus.cc:482] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:04:04.335775 7864 raft_consensus.cc:3037] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:04.336505 7864 raft_consensus.cc:504] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:04.336645 7864 leader_election.cc:288] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 1 election: Requested vote from peers a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009), dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135)
I20260811 01:04:04.336859 8005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e89a10b1cdb8497f9c856b550c4676ec" candidate_uuid: "fd7f7c369f604f18a121656d20e59ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1f3b428c8a7451197a3e54a1c1bab79"
I20260811 01:04:04.336867 8206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e89a10b1cdb8497f9c856b550c4676ec" candidate_uuid: "fd7f7c369f604f18a121656d20e59ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc3f94b4d6814e45ab81a44e7e671389"
I20260811 01:04:04.336943 8005 raft_consensus.cc:3037] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:04.336949 8206 raft_consensus.cc:3037] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:04.337730 8005 raft_consensus.cc:2454] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd7f7c369f604f18a121656d20e59ed7 in term 1.
I20260811 01:04:04.337975 8206 raft_consensus.cc:2454] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd7f7c369f604f18a121656d20e59ed7 in term 1.
I20260811 01:04:04.338079 7680 leader_election.cc:302] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1f3b428c8a7451197a3e54a1c1bab79, fd7f7c369f604f18a121656d20e59ed7; no voters:
I20260811 01:04:04.338189 7864 raft_consensus.cc:2781] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:04.338326 7864 raft_consensus.cc:686] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 LEADER]: Becoming Leader. State: Replica: fd7f7c369f604f18a121656d20e59ed7, State: Running, Role: LEADER
I20260811 01:04:04.338409 7864 consensus_queue.cc:237] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:04.339423 7557 catalog_manager.cc:5495] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd7f7c369f604f18a121656d20e59ed7 (127.13.30.129). New cstate: current_term: 1 leader_uuid: "fd7f7c369f604f18a121656d20e59ed7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } health_report { overall_health: HEALTHY } } }
I20260811 01:04:04.399950 8309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:04.397163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49732 (local address 127.13.30.129:40519)
0811 01:04:04.397318 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:04.397319 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:04.397326 (+ 7us) server_negotiation.cc:407] Connection header received
0811 01:04:04.397368 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:04.397368 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:04.397389 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:04.397478 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:04:04.397617 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.398107 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.398862 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:04.399065 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:04.399116 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:04.399558 (+ 442us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:04:04.399685 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:04:04.399751 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:04.399813 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 01:04:04.399838 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":81,"threads_started":1}
I20260811 01:04:04.401640 8206 raft_consensus.cc:1261] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389 [term 1 FOLLOWER]: Refusing update from remote peer fd7f7c369f604f18a121656d20e59ed7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:04:04.401655 8005 raft_consensus.cc:1261] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79 [term 1 FOLLOWER]: Refusing update from remote peer fd7f7c369f604f18a121656d20e59ed7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:04:04.401993 7864 consensus_queue.cc:1035] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:04:04.402153 8303 consensus_queue.cc:1035] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:04:04.404778 8310 mvcc.cc:205] Tried to move back new op lower bound from 7317136361066328064 to 7317136360810627072. Current Snapshot: MvccSnapshot[applied={T|T < 7317136361066328064}]
I20260811 01:04:04.404884 8312 mvcc.cc:205] Tried to move back new op lower bound from 7317136361066328064 to 7317136360810627072. Current Snapshot: MvccSnapshot[applied={T|T < 7317136361066328064}]
I20260811 01:04:04.407127 7557 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:04:04.407243 7557 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:04:04.407969 7557 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Sending DeleteTablet for 3 replicas of tablet e89a10b1cdb8497f9c856b550c4676ec
I20260811 01:04:04.408295 7968 tablet_service.cc:1514] Processing DeleteTablet for tablet e89a10b1cdb8497f9c856b550c4676ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:04 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:51590
I20260811 01:04:04.408332 8174 tablet_service.cc:1514] Processing DeleteTablet for tablet e89a10b1cdb8497f9c856b550c4676ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:04 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:33136
I20260811 01:04:04.408505 7751 tablet_service.cc:1514] Processing DeleteTablet for tablet e89a10b1cdb8497f9c856b550c4676ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:04 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:49730
I20260811 01:04:04.408551 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 7621
I20260811 01:04:04.421628 8328 tablet_replica.cc:330] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79: stopping tablet replica
I20260811 01:04:04.421651 8327 tablet_replica.cc:330] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389: stopping tablet replica
I20260811 01:04:04.421835 8327 raft_consensus.cc:2229] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:04.421835 8328 raft_consensus.cc:2229] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:04.421988 8327 raft_consensus.cc:2258] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:04.421988 8328 raft_consensus.cc:2258] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:04.422531 8327 ts_tablet_manager.cc:1905] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:04.422533 8328 ts_tablet_manager.cc:1905] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:04.424177 8328 ts_tablet_manager.cc:1918] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:04.424273 8328 log.cc:1196] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/e89a10b1cdb8497f9c856b550c4676ec
I20260811 01:04:04.424309 8327 ts_tablet_manager.cc:1918] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:04.424451 8327 log.cc:1196] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/e89a10b1cdb8497f9c856b550c4676ec
I20260811 01:04:04.424587 8328 ts_tablet_manager.cc:1939] T e89a10b1cdb8497f9c856b550c4676ec P a1f3b428c8a7451197a3e54a1c1bab79: Deleting consensus metadata
I20260811 01:04:04.424860 8327 ts_tablet_manager.cc:1939] T e89a10b1cdb8497f9c856b550c4676ec P dc3f94b4d6814e45ab81a44e7e671389: Deleting consensus metadata
I20260811 01:04:04.425241 7534 catalog_manager.cc:4841] TS a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009): tablet e89a10b1cdb8497f9c856b550c4676ec (table test-table [id=0a89aedde8a84b7bbd33154d47c7621c]) successfully deleted
I20260811 01:04:04.425402 7529 catalog_manager.cc:4841] TS dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135): tablet e89a10b1cdb8497f9c856b550c4676ec (table test-table [id=0a89aedde8a84b7bbd33154d47c7621c]) successfully deleted
W20260811 01:04:04.426945 7536 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:40519 (error 108)
I20260811 01:04:04.427588 8289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:04.427420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:40519 (local address 127.0.0.1:49740)
0811 01:04:04.427497 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:04.427555 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:40519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 01:04:04.427618 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 7863
W20260811 01:04:04.427762 7536 catalog_manager.cc:4584] TS fd7f7c369f604f18a121656d20e59ed7 (127.13.30.129:40519): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e89a10b1cdb8497f9c856b550c4676ec: Network error: Client connection negotiation failed: client connection to 127.13.30.129:40519: connect: Connection refused (error 111)
I20260811 01:04:04.450060 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 8078
I20260811 01:04:04.461081 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 7500
I20260811 01:04:24.482236 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:35391
--webserver_interface=127.13.30.190
--webserver_port=33103
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:37693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:35391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:24.578640 8331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:24.578953 8331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:24.578994 8331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:24.580343 8331 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 01:04:24.580401 8331 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 01:04:24.580412 8331 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 01:04:24.580423 8331 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:04:24.580435 8331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:24.580448 8331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:24.580459 8331 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:04:24.580469 8331 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:04:24.582235 8331 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:37693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:35391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:35391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=33103
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:24.582512 8331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:24.582727 8331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:24.588454 8342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:24.588617 8331 server_base.cc:1034] running on GCE node
W20260811 01:04:24.588456 8340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:24.588454 8337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:24.589267 8331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:24.589689 8331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:24.590860 8331 hybrid_clock.cc:648] HybridClock initialized: now 1786410264590810 us; error 78 us; skew 500 ppm
Aug 11 01:04:24 dist-test-slave-42z9 krb5kdc[6662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410264, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:24.593757 8331 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:04:24.594300 8331 webserver.cc:460] Webserver started at http://127.13.30.190:33103/ using document root <none> and password file <none>
I20260811 01:04:24.594539 8331 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:24.594594 8331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:24.596104 8331 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:24.596961 8352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:24.597237 8331 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:24.597343 8331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "b45e327162abdef701779524dc4ad7c7"
server_key_iv: "70c5587fde7a3194c6b3f9ca553490fa"
server_key_version: "encryptionkey@0"
I20260811 01:04:24.597782 8331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:24.612267 8331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:24.614584 8331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:24.614914 8331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:24.619879 8331 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:35391
I20260811 01:04:24.619936 8442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:35391 every 8 connection(s)
I20260811 01:04:24.620311 8331 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:04:24.621923 8443 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:04:24.622664 8443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Bootstrap starting.
I20260811 01:04:24.630131 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 8331
I20260811 01:04:24.630497 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:40519
--local_ip_for_outbound_sockets=127.13.30.129
--tserver_master_addrs=127.13.30.190:35391
--webserver_port=44087
--webserver_interface=127.13.30.129
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:37693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:04:24.631990 8443 log.cc:824] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:24.636152 8443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:04:24.636565 8443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Bootstrap complete.
I20260811 01:04:24.640337 8443 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } }
I20260811 01:04:24.640722 8443 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93ca4f60d5bd4e2c909fe86310d4ddfa, State: Initialized, Role: FOLLOWER
I20260811 01:04:24.640926 8443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } }
I20260811 01:04:24.641140 8443 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:04:24.641196 8443 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:04:24.641248 8443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 2 FOLLOWER]: Advancing to term 3
I20260811 01:04:24.642904 8443 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } }
I20260811 01:04:24.643045 8443 leader_election.cc:302] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93ca4f60d5bd4e2c909fe86310d4ddfa; no voters:
I20260811 01:04:24.643242 8443 leader_election.cc:288] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 01:04:24.643323 8447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 3 FOLLOWER]: Leader election won for term 3
I20260811 01:04:24.643563 8447 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [term 3 LEADER]: Becoming Leader. State: Replica: 93ca4f60d5bd4e2c909fe86310d4ddfa, State: Running, Role: LEADER
I20260811 01:04:24.643565 8443 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:04:24.643778 8447 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } }
I20260811 01:04:24.644135 8449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93ca4f60d5bd4e2c909fe86310d4ddfa. Latest consensus state: current_term: 3 leader_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } } }
I20260811 01:04:24.644136 8448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93ca4f60d5bd4e2c909fe86310d4ddfa" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35391 } } }
I20260811 01:04:24.644243 8449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:24.644246 8448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:24.645200 8456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:04:24.646121 8456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:04:24.646255 8456 catalog_manager.cc:1259] Loaded cluster ID: bd97ef02b87c44afbe44f8e5301c0729
I20260811 01:04:24.646303 8456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:04:24.648046 8456 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:04:24.648440 8456 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Loaded TSK: 0
I20260811 01:04:24.648550 8456 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 93ca4f60d5bd4e2c909fe86310d4ddfa: Loaded TSK: 1
F20260811 01:04:24.648828 8456 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2fa784a9ad google::LogMessage::Fail() at ??:0
@ 0x7f2fa784d88a google::LogMessage::SendToLog() at ??:0
@ 0x7f2fa784a4de google::LogMessage::Flush() at ??:0
@ 0x7f2fa784ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2fa9fb7104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f2fa9fb4d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f2faf7a41cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f2faf7a448e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f2faf7a4594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f2faf76ac48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f2faf774ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2fa97180d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2fa970d954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2faa5716db start_thread at ??:0
@ 0x7f2fa634861f clone at ??:0
W20260811 01:04:24.748783 8446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:24.749038 8446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:24.749068 8446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:24.750524 8446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:24.750582 8446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:24.750614 8446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:04:24.752377 8446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:37693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:40519
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=44087
--tserver_master_addrs=127.13.30.190:35391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:24.752650 8446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:24.752911 8446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:24.758209 8496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:24.758381 8505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:24.758220 8500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:24.758615 8446 server_base.cc:1034] running on GCE node
I20260811 01:04:24.758849 8446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:24.759137 8446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:24.760295 8446 hybrid_clock.cc:648] HybridClock initialized: now 1786410264760285 us; error 30 us; skew 500 ppm
Aug 11 01:04:24 dist-test-slave-42z9 krb5kdc[6662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410264, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:24.762944 8446 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:04:24.763459 8446 webserver.cc:460] Webserver started at http://127.13.30.129:44087/ using document root <none> and password file <none>
I20260811 01:04:24.763696 8446 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:24.763742 8446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:24.765110 8446 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:24.765810 8517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:24.765967 8446 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:24.766055 8446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "fd7f7c369f604f18a121656d20e59ed7"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "b27a8253c6e51b59a429b6399e9711cb"
server_key_iv: "3a715c272f9ef7b5172df2e7c06b8546"
server_key_version: "encryptionkey@0"
I20260811 01:04:24.766434 8446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:24.775774 8446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:24.778561 8446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:24.778703 8446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:24.778954 8446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:24.779479 8529 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 01:04:24.781818 8446 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 01:04:24.781931 8446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260811 01:04:24.781986 8446 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 01:04:24.782938 8446 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 01:04:24.783011 8446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 01:04:24.783100 8529 tablet_bootstrap.cc:492] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7: Bootstrap starting.
I20260811 01:04:24.789705 8446 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:40519
I20260811 01:04:24.789795 8686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:40519 every 8 connection(s)
I20260811 01:04:24.790239 8446 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:04:24.795624 8529 log.cc:824] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:24.798911 8529 tablet_bootstrap.cc:492] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:04:24.799279 8529 tablet_bootstrap.cc:492] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7: Bootstrap complete.
I20260811 01:04:24.800418 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 8446
I20260811 01:04:24.800604 8529 ts_tablet_manager.cc:1397] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.011s
I20260811 01:04:24.800720 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:43009
--local_ip_for_outbound_sockets=127.13.30.130
--tserver_master_addrs=127.13.30.190:35391
--webserver_port=33751
--webserver_interface=127.13.30.130
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:37693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:04:24.802246 8529 raft_consensus.cc:348] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:24.802696 8529 raft_consensus.cc:729] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd7f7c369f604f18a121656d20e59ed7, State: Initialized, Role: FOLLOWER
I20260811 01:04:24.802901 8529 consensus_queue.cc:260] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:24.803222 8529 ts_tablet_manager.cc:1428] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7: Time spent starting tablet: real 0.003s user 0.006s sys 0.000s
W20260811 01:04:24.906193 8690 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:04:24.790918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:59559)
0811 01:04:24.791109 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:24.791157 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:24.792077 (+ 920us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:24.905961 (+113884us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":94,"threads_started":1}
W20260811 01:04:24.906464 8688 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:35391 (0 consecutive failures): Network error: Failed to ping master at 127.13.30.190:35391: Client connection negotiation failed: client connection to 127.13.30.190:35391: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 01:04:24.906802 8690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:24.906690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:41397)
0811 01:04:24.906739 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:24.906781 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 01:04:24.907130 8690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:24.907046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:42233)
0811 01:04:24.907086 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:24.907109 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 01:04:24.907232 8688 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:04:24.923791 8694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:24.924060 8694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:24.924098 8694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:24.925514 8694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:24.925580 8694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:24.925624 8694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:04:24.927414 8694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:37693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:43009
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=33751
--tserver_master_addrs=127.13.30.190:35391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:24.927742 8694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:24.928004 8694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:24.933590 8711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:24.933594 8709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:24.933614 8707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:24.933952 8694 server_base.cc:1034] running on GCE node
I20260811 01:04:24.934195 8694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:24.934463 8694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:24.935607 8694 hybrid_clock.cc:648] HybridClock initialized: now 1786410264935591 us; error 38 us; skew 500 ppm
Aug 11 01:04:24 dist-test-slave-42z9 krb5kdc[6662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410264, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:24.938625 8694 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:04:24.939235 8694 webserver.cc:460] Webserver started at http://127.13.30.130:33751/ using document root <none> and password file <none>
I20260811 01:04:24.939507 8694 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:24.939558 8694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:24.941053 8694 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:24.941877 8720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:24.942045 8694 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 01:04:24.942140 8694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "a1f3b428c8a7451197a3e54a1c1bab79"
format_stamp: "Formatted at 2026-08-11 01:03:42 on dist-test-slave-42z9"
server_key: "6e5b3a0f61437bc5f6a512a0ca9aaad0"
server_key_iv: "efa402a338577517eb5e8bfa013f3516"
server_key_version: "encryptionkey@0"
I20260811 01:04:24.942554 8694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:24.958495 8694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:24.960637 8694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:24.960772 8694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:24.961021 8694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:24.961341 8694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:24.961377 8694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:24.961400 8694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:24.961410 8694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:24.967891 8694 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:43009
I20260811 01:04:24.967941 8886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:43009 every 8 connection(s)
I20260811 01:04:24.968569 8694 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:04:24.970112 8890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:24.969586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:38731)
0811 01:04:24.969843 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:24.969929 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":121,"threads_started":1}
W20260811 01:04:24.970647 8888 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:35391 (0 consecutive failures): Network error: Failed to ping master at 127.13.30.190:35391: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
I20260811 01:04:24.971033 8890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:24.970906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:39603)
0811 01:04:24.970973 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:24.971008 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 01:04:24.971477 8890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:24.971396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:55809)
0811 01:04:24.971433 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:24.971461 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260811 01:04:24.971649 8888 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 01:04:24.972338 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 8694
I20260811 01:04:24.972625 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:38135
--local_ip_for_outbound_sockets=127.13.30.131
--tserver_master_addrs=127.13.30.190:35391
--webserver_port=45445
--webserver_interface=127.13.30.131
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:37693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:25.062436 8893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:25.062675 8893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:25.062709 8893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:25.063961 8893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:25.064013 8893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:25.064054 8893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:04:25.065763 8893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:37693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:38135
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=45445
--tserver_master_addrs=127.13.30.190:35391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:25.066051 8893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:25.066298 8893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:25.071992 8906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:25.072059 8903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:25.071992 8904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:25.072353 8893 server_base.cc:1034] running on GCE node
I20260811 01:04:25.072826 8893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:25.073287 8893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:25.074546 8893 hybrid_clock.cc:648] HybridClock initialized: now 1786410265074485 us; error 74 us; skew 500 ppm
Aug 11 01:04:25 dist-test-slave-42z9 krb5kdc[6662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410265, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:25.077852 8893 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:04:25.078392 8893 webserver.cc:460] Webserver started at http://127.13.30.131:45445/ using document root <none> and password file <none>
I20260811 01:04:25.078647 8893 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:25.078701 8893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:25.080281 8893 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:04:25.080955 8915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:25.081132 8893 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:25.081367 8893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "dc3f94b4d6814e45ab81a44e7e671389"
format_stamp: "Formatted at 2026-08-11 01:03:43 on dist-test-slave-42z9"
server_key: "db278623ed81d742fca3881f7c394973"
server_key_iv: "b783d1fa6bae55fb457ce08754ec42aa"
server_key_version: "encryptionkey@0"
I20260811 01:04:25.082190 8893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:25.107218 8893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:25.109866 8893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:25.110023 8893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:25.110270 8893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:25.110607 8893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:25.110647 8893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:25.110678 8893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:25.110695 8893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:25.116387 8893 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:38135
I20260811 01:04:25.116456 9100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:38135 every 8 connection(s)
I20260811 01:04:25.116803 8893 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:04:25.117961 9109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:25.117538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:56543)
0811 01:04:25.117726 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:25.117803 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":84,"threads_started":1}
W20260811 01:04:25.118391 9103 heartbeater.cc:644] Failed to heartbeat to 127.13.30.190:35391 (0 consecutive failures): Network error: Failed to ping master at 127.13.30.190:35391: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
I20260811 01:04:25.118788 9109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:25.118702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:54541)
0811 01:04:25.118743 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:25.118769 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 01:04:25.119015 9109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:25.118952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:60797)
0811 01:04:25.118985 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:25.119003 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 01:04:25.119096 9103 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 01:04:25.119706 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 8893
I20260811 01:04:25.908330 9113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:25.907910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:36253)
0811 01:04:25.908161 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:25.908221 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":113,"threads_started":1}
I20260811 01:04:25.972486 9115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:25.972118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:39523)
0811 01:04:25.972317 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:25.972393 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":75,"threads_started":1}
I20260811 01:04:26.119793 9116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:26.119519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:55637)
0811 01:04:26.119677 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:26.119725 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":68,"threads_started":1}
I20260811 01:04:26.582561 9117 raft_consensus.cc:482] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:04:26.582741 9117 raft_consensus.cc:504] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:26.583117 9117 leader_election.cc:288] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009), dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135)
Aug 11 01:04:26 dist-test-slave-42z9 krb5kdc[6662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410264, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.130@KRBTEST.COM
Aug 11 01:04:26 dist-test-slave-42z9 krb5kdc[6662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410264, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.131@KRBTEST.COM
I20260811 01:04:26.601696 9119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:26.583384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:43009 (local address 127.13.30.129:40131)
0811 01:04:26.583510 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:26.583522 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:26.583583 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:26.584428 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:26.584432 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:26.584917 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:26.585228 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:26.585238 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:26.586454 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:26.586456 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:26.587392 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:26.587396 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:26.588151 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:26.588154 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:26.588339 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:26.593551 (+ 5212us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:04:26.593571 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:26.595911 (+ 2340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:26.599220 (+ 3309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:26.599242 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:26.599245 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:26.599816 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:26.600150 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:26.600151 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:26.600151 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:26.600317 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:26.600953 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:26.600964 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:26.601164 (+ 200us) client_negotiation.cc:769] Sending connection context
0811 01:04:26.601296 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 01:04:26.601567 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":114,"thread_start_us":71,"threads_started":1}
I20260811 01:04:26.601737 9121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:26.583459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:40131 (local address 127.13.30.130:43009)
0811 01:04:26.583641 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:26.583653 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:26.583681 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:04:26.584146 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:26.584149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:26.584203 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:26.584475 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:26.585383 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:26.586316 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:26.587502 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:26.587948 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:26.588036 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:26.596186 (+ 8150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:26.596196 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:26.596197 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:26.596227 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:26.599056 (+ 2829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:26.599924 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:26.599928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:26.599928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:26.600081 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:26.600431 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:26.600433 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:26.600433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:26.600833 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:26.600934 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:26.601399 (+ 465us) server_negotiation.cc:299] Negotiation successful
0811 01:04:26.601605 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":60,"threads_started":1}
I20260811 01:04:26.601732 9122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:26.583579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:37599 (local address 127.13.30.131:38135)
0811 01:04:26.583713 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:26.583722 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:26.583750 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:04:26.584238 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:26.584241 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:26.584284 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:26.584473 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:26.585376 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:26.586364 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:26.587509 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:26.588298 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:26.588466 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:26.596226 (+ 7760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:26.596231 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:26.596232 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:26.596246 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:26.599059 (+ 2813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:26.599924 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:26.599928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:26.599928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:26.600081 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:26.600436 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:26.600438 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:26.600438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:26.600833 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:26.600934 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:26.601399 (+ 465us) server_negotiation.cc:299] Negotiation successful
0811 01:04:26.601613 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":58,"threads_started":1}
I20260811 01:04:26.601758 9120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:26.583355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:38135 (local address 127.13.30.129:37599)
0811 01:04:26.583510 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:26.583522 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:26.583583 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:26.584464 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:26.584466 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:26.584938 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:26.585228 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:26.585238 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:26.586522 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:26.586522 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:26.587390 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:26.587394 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:26.588460 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:26.588461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:26.588539 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:26.593551 (+ 5012us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:04:26.593574 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:26.596030 (+ 2456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:26.599220 (+ 3190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:26.599242 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:26.599245 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:26.599816 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:26.600150 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:26.600151 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:26.600151 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:26.600317 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:26.600952 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:26.600964 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:26.601164 (+ 200us) client_negotiation.cc:769] Sending connection context
0811 01:04:26.601296 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 01:04:26.601642 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":227,"thread_start_us":80,"threads_started":1}
W20260811 01:04:26.602910 8521 leader_election.cc:341] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009): Not found: Tablet not found: e89a10b1cdb8497f9c856b550c4676ec
W20260811 01:04:26.602995 8519 leader_election.cc:341] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135): Not found: Tablet not found: e89a10b1cdb8497f9c856b550c4676ec
I20260811 01:04:26.603070 8519 leader_election.cc:302] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd7f7c369f604f18a121656d20e59ed7; no voters: a1f3b428c8a7451197a3e54a1c1bab79, dc3f94b4d6814e45ab81a44e7e671389
I20260811 01:04:26.603240 9117 raft_consensus.cc:2726] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:04:26.909291 9120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:26.909086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:55227)
0811 01:04:26.909170 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:26.909241 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 01:04:26.973538 9123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:26.973182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:36219)
0811 01:04:26.973365 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:26.973433 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":92,"threads_started":1}
I20260811 01:04:27.120720 9124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:27.120420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:59165)
0811 01:04:27.120615 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:27.120667 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":83,"threads_started":1}
I20260811 01:04:27.910537 9125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:27.910104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:35229)
0811 01:04:27.910338 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:27.910403 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":113,"threads_started":1}
I20260811 01:04:27.974565 9126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:27.974154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:51969)
0811 01:04:27.974333 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:27.974383 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":75,"threads_started":1}
I20260811 01:04:28.121658 9127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:28.121330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:34779)
0811 01:04:28.121555 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:28.121605 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":90,"threads_started":1}
I20260811 01:04:28.535454 9128 raft_consensus.cc:482] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:04:28.535619 9128 raft_consensus.cc:504] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:28.536051 9128 leader_election.cc:288] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009), dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135)
W20260811 01:04:28.536537 8521 leader_election.cc:341] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009): Not found: Tablet not found: e89a10b1cdb8497f9c856b550c4676ec
W20260811 01:04:28.536661 8519 leader_election.cc:341] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135): Not found: Tablet not found: e89a10b1cdb8497f9c856b550c4676ec
I20260811 01:04:28.536743 8519 leader_election.cc:302] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd7f7c369f604f18a121656d20e59ed7; no voters: a1f3b428c8a7451197a3e54a1c1bab79, dc3f94b4d6814e45ab81a44e7e671389
I20260811 01:04:28.536846 9128 raft_consensus.cc:2726] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:04:28.912020 9129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:28.911577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:33097)
0811 01:04:28.911839 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:28.911917 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":84,"threads_started":1}
I20260811 01:04:28.975596 9130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:28.975298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:39077)
0811 01:04:28.975477 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:28.975525 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":78,"threads_started":1}
I20260811 01:04:29.122696 9133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:29.122311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:42679)
0811 01:04:29.122576 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:29.122640 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":130,"threads_started":1}
I20260811 01:04:29.913170 9136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:29.912854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:51427)
0811 01:04:29.913053 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:29.913105 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":76,"threads_started":1}
I20260811 01:04:29.976737 9138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:29.976298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:33665)
0811 01:04:29.976517 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:29.976674 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":107,"threads_started":1}
I20260811 01:04:30.123591 9139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:30.123297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:58633)
0811 01:04:30.123495 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:30.123541 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":93,"threads_started":1}
I20260811 01:04:30.914043 9140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:30.913761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:40507)
0811 01:04:30.913936 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:30.913989 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":75,"threads_started":1}
I20260811 01:04:30.977695 9142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:30.977382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:52533)
0811 01:04:30.977571 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:30.977622 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":118,"threads_started":1}
I20260811 01:04:31.047541 9143 raft_consensus.cc:482] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:04:31.047654 9143 raft_consensus.cc:504] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:31.047852 9143 leader_election.cc:288] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009), dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135)
W20260811 01:04:31.048200 8521 leader_election.cc:341] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009): Not found: Tablet not found: e89a10b1cdb8497f9c856b550c4676ec
W20260811 01:04:31.048259 8519 leader_election.cc:341] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135): Not found: Tablet not found: e89a10b1cdb8497f9c856b550c4676ec
I20260811 01:04:31.048334 8519 leader_election.cc:302] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd7f7c369f604f18a121656d20e59ed7; no voters: a1f3b428c8a7451197a3e54a1c1bab79, dc3f94b4d6814e45ab81a44e7e671389
I20260811 01:04:31.048408 9143 raft_consensus.cc:2726] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:04:31.124415 9146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:31.124150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:37187)
0811 01:04:31.124320 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:31.124367 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":86,"threads_started":1}
I20260811 01:04:31.914832 9149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:31.914586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:40837)
0811 01:04:31.914745 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:31.914783 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":74,"threads_started":1}
I20260811 01:04:31.978533 9151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:31.978276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:55835)
0811 01:04:31.978437 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:31.978484 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":70,"threads_started":1}
I20260811 01:04:32.125280 9154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:32.125015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:41653)
0811 01:04:32.125179 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:32.125228 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":71,"threads_started":1}
I20260811 01:04:32.915805 9156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:32.915508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:47113)
0811 01:04:32.915706 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:32.915755 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":79,"threads_started":1}
I20260811 01:04:32.979385 9157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:32.979066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:46709)
0811 01:04:32.979269 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:32.979330 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":94,"threads_started":1}
I20260811 01:04:33.126086 9158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:33.125781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:39191)
0811 01:04:33.125970 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:33.126031 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":91,"threads_started":1}
I20260811 01:04:33.916747 9159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:33.916472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:44583)
0811 01:04:33.916644 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:33.916694 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":77,"threads_started":1}
I20260811 01:04:33.980420 9160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:33.980143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:49061)
0811 01:04:33.980316 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:33.980365 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":76,"threads_started":1}
I20260811 01:04:34.127143 9161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:34.126699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:38771)
0811 01:04:34.126969 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:34.127054 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":106,"threads_started":1}
I20260811 01:04:34.917826 9163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:34.917547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:53299)
0811 01:04:34.917714 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:34.917767 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":76,"threads_started":1}
I20260811 01:04:34.981549 9165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:34.981215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:51145)
0811 01:04:34.981401 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:34.981482 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":85,"threads_started":1}
I20260811 01:04:35.128108 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:35.127824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:39189)
0811 01:04:35.128001 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:35.128051 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":78,"threads_started":1}
I20260811 01:04:35.762717 9168 raft_consensus.cc:482] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:04:35.762836 9168 raft_consensus.cc:504] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:35.763051 9168 leader_election.cc:288] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009), dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135)
W20260811 01:04:35.763427 8519 leader_election.cc:341] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135): Not found: Tablet not found: e89a10b1cdb8497f9c856b550c4676ec
W20260811 01:04:35.763518 8521 leader_election.cc:341] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009): Not found: Tablet not found: e89a10b1cdb8497f9c856b550c4676ec
I20260811 01:04:35.763592 8521 leader_election.cc:302] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd7f7c369f604f18a121656d20e59ed7; no voters: a1f3b428c8a7451197a3e54a1c1bab79, dc3f94b4d6814e45ab81a44e7e671389
I20260811 01:04:35.763675 9168 raft_consensus.cc:2726] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:04:35.918778 9170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:35.918456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:43001)
0811 01:04:35.918676 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:35.918726 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":101,"threads_started":1}
I20260811 01:04:35.982631 9172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:35.982242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:58477)
0811 01:04:35.982474 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:35.982570 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":112,"threads_started":1}
I20260811 01:04:36.129122 9173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:36.128728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:41729)
0811 01:04:36.128961 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:36.129042 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":80,"threads_started":1}
I20260811 01:04:36.919703 9174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:36.919486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:41999)
0811 01:04:36.919616 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:36.919654 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
I20260811 01:04:36.983592 9177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:36.983297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:53569)
0811 01:04:36.983470 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:36.983540 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":74,"threads_started":1}
I20260811 01:04:37.130350 9179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:37.129942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:43467)
0811 01:04:37.130181 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:37.130270 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":86,"threads_started":1}
I20260811 01:04:37.920583 9181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:37.920231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:50337)
0811 01:04:37.920473 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:37.920529 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":103,"threads_started":1}
I20260811 01:04:37.984489 9182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:37.984215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:46655)
0811 01:04:37.984371 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:37.984419 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":70,"threads_started":1}
I20260811 01:04:38.131273 9184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:38.131011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:35015)
0811 01:04:38.131190 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:38.131222 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":81,"threads_started":1}
I20260811 01:04:38.194278 9185 raft_consensus.cc:482] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:04:38.194407 9185 raft_consensus.cc:504] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1f3b428c8a7451197a3e54a1c1bab79" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 43009 } } peers { permanent_uuid: "dc3f94b4d6814e45ab81a44e7e671389" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 38135 } } peers { permanent_uuid: "fd7f7c369f604f18a121656d20e59ed7" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 40519 } }
I20260811 01:04:38.194641 9185 leader_election.cc:288] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009), dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135)
W20260811 01:04:38.195051 8521 leader_election.cc:341] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a1f3b428c8a7451197a3e54a1c1bab79 (127.13.30.130:43009): Not found: Tablet not found: e89a10b1cdb8497f9c856b550c4676ec
W20260811 01:04:38.195291 8519 leader_election.cc:341] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc3f94b4d6814e45ab81a44e7e671389 (127.13.30.131:38135): Not found: Tablet not found: e89a10b1cdb8497f9c856b550c4676ec
I20260811 01:04:38.195362 8519 leader_election.cc:302] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd7f7c369f604f18a121656d20e59ed7; no voters: a1f3b428c8a7451197a3e54a1c1bab79, dc3f94b4d6814e45ab81a44e7e671389
I20260811 01:04:38.195425 9185 raft_consensus.cc:2726] T e89a10b1cdb8497f9c856b550c4676ec P fd7f7c369f604f18a121656d20e59ed7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:04:38.921461 9187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:38.921156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:34953)
0811 01:04:38.921328 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:38.921372 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":88,"threads_started":1}
I20260811 01:04:38.985347 9188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:38.985126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:33105)
0811 01:04:38.985263 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:38.985296 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":74,"threads_started":1}
I20260811 01:04:39.132436 9189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:39.132047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:55601)
0811 01:04:39.132300 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:39.132383 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":122,"threads_started":1}
I20260811 01:04:39.922322 9190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:39.922093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.129:49921)
0811 01:04:39.922228 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:39.922274 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":73,"threads_started":1}
I20260811 01:04:39.986189 9192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:39.985918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.130:59795)
0811 01:04:39.986083 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:39.986135 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":69,"threads_started":1}
I20260811 01:04:40.128413 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 8446
I20260811 01:04:40.134168 9193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:40.133705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35391 (local address 127.13.30.131:38039)
0811 01:04:40.133998 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:40.134107 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.190:35391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":87,"threads_started":1}
I20260811 01:04:40.141937 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 8694
I20260811 01:04:40.169672 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 8893
2026-08-11T01:04:40Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59041 ms)
[----------] 30 tests from SecurityITest (250088 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:04:40 dist-test-slave-42z9 krb5kdc[9197](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:04:40 dist-test-slave-42z9 krb5kdc[9197](info): set up 2 sockets
Aug 11 01:04:40 dist-test-slave-42z9 krb5kdc[9197](info): commencing operation
krb5kdc: starting...
W20260811 01:04:41.365733 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:04:41 dist-test-slave-42z9 krb5kdc[9197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:04:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:04:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:04:41.497952 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:37495
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:37495
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:41.582923 9215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:41.583161 9215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:41.583184 9215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:41.584393 9215 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:04:41.584435 9215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:41.584448 9215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:41.584460 9215 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:04:41.584471 9215 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:04:41.585980 9215 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:37495
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:37495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:41.586215 9215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:41.586476 9215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:04:41.591667 9215 server_base.cc:1034] running on GCE node
W20260811 01:04:41.591763 9224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:41.591815 9228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:41.592015 9221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:41.592373 9215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:41.592746 9215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:41.593930 9215 hybrid_clock.cc:648] HybridClock initialized: now 1786410281593914 us; error 33 us; skew 500 ppm
Aug 11 01:04:41 dist-test-slave-42z9 krb5kdc[9197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410281, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:41.596469 9215 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:04:41.596966 9215 webserver.cc:460] Webserver started at http://127.13.30.190:33705/ using document root <none> and password file <none>
I20260811 01:04:41.597163 9215 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:41.597196 9215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:41.597337 9215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:41.598537 9215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "00e6687a9175430ea8041fd574559e7b"
format_stamp: "Formatted at 2026-08-11 01:04:41 on dist-test-slave-42z9"
server_key: "c57817c8fe92a82cd73489efabc64d7f"
server_key_iv: "ee9cf397b73e590ee1028ae724eb6926"
server_key_version: "encryptionkey@0"
I20260811 01:04:41.599022 9215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "00e6687a9175430ea8041fd574559e7b"
format_stamp: "Formatted at 2026-08-11 01:04:41 on dist-test-slave-42z9"
server_key: "c57817c8fe92a82cd73489efabc64d7f"
server_key_iv: "ee9cf397b73e590ee1028ae724eb6926"
server_key_version: "encryptionkey@0"
I20260811 01:04:41.600462 9215 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:04:41.601338 9237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:41.601570 9215 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:41.601673 9215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "00e6687a9175430ea8041fd574559e7b"
format_stamp: "Formatted at 2026-08-11 01:04:41 on dist-test-slave-42z9"
server_key: "c57817c8fe92a82cd73489efabc64d7f"
server_key_iv: "ee9cf397b73e590ee1028ae724eb6926"
server_key_version: "encryptionkey@0"
I20260811 01:04:41.601745 9215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:41.613713 9215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:41.615938 9215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:41.616089 9215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:41.620283 9215 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:37495
I20260811 01:04:41.620334 9313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:37495 every 8 connection(s)
I20260811 01:04:41.620678 9215 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:04:41.621640 9317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:41.624019 9317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b: Bootstrap starting.
I20260811 01:04:41.624429 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 9215
I20260811 01:04:41.624540 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:04:41.624711 9317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:41.624722 13434 external_mini_cluster.cc:1428] Setting key ef523de2d4b88206fd1ea3c581ec6755
I20260811 01:04:41.624994 9317 log.cc:824] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:41.625824 9317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b: No bootstrap required, opened a new log
I20260811 01:04:41.627709 9317 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00e6687a9175430ea8041fd574559e7b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37495 } }
I20260811 01:04:41.627851 9317 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:41.627883 9317 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e6687a9175430ea8041fd574559e7b, State: Initialized, Role: FOLLOWER
I20260811 01:04:41.628017 9317 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00e6687a9175430ea8041fd574559e7b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37495 } }
I20260811 01:04:41.628093 9317 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:04:41.628135 9317 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:04:41.628183 9317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:41.628779 9317 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00e6687a9175430ea8041fd574559e7b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37495 } }
I20260811 01:04:41.628883 9317 leader_election.cc:302] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00e6687a9175430ea8041fd574559e7b; no voters:
I20260811 01:04:41.629050 9317 leader_election.cc:288] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:04:41.629086 9325 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:41.629273 9325 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [term 1 LEADER]: Becoming Leader. State: Replica: 00e6687a9175430ea8041fd574559e7b, State: Running, Role: LEADER
I20260811 01:04:41.629364 9317 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:04:41.629510 9325 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00e6687a9175430ea8041fd574559e7b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37495 } }
I20260811 01:04:41.629999 9327 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00e6687a9175430ea8041fd574559e7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00e6687a9175430ea8041fd574559e7b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37495 } } }
I20260811 01:04:41.630089 9327 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:41.630715 9339 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:04:41.631367 9339 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:04:41.631814 9329 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00e6687a9175430ea8041fd574559e7b. Latest consensus state: current_term: 1 leader_uuid: "00e6687a9175430ea8041fd574559e7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00e6687a9175430ea8041fd574559e7b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 37495 } } }
I20260811 01:04:41.631996 9329 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b [sys.catalog]: This master's current role is: LEADER
Aug 11 01:04:41 dist-test-slave-42z9 krb5kdc[9197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:04:41.633138 9339 catalog_manager.cc:1347] Generated new cluster ID: afb3c5269d004fa8b1e2b7bd43400318
I20260811 01:04:41.633181 9339 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:04:41.636531 9324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:41.625257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42718 (local address 127.13.30.190:37495)
0811 01:04:41.625510 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:41.625519 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:41.625546 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:04:41.626045 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:41.626052 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:41.626104 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:41.626233 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:41.626856 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:41.627760 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:41.628619 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:41.629491 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:41.629816 (+ 325us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:41.632785 (+ 2969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:41.632789 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:41.632789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:41.632803 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:41.634824 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:41.635274 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:41.635277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:41.635277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:41.635383 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:41.635596 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:41.635596 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:41.635597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:41.635894 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:41.636031 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:41.636159 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 01:04:41.636302 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":71,"threads_started":1}
I20260811 01:04:41.646364 9339 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:04:41.647146 9339 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:04:41.653875 9339 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b: Generated new TSK 0
I20260811 01:04:41.654093 9339 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:04:41.684728 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37495
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:41.771745 9357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:41.772001 9357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:41.772027 9357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:41.773254 9357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:41.773303 9357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:41.773332 9357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:04:41.776067 9357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37495
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:41.776461 9357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:41.776734 9357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:41.783099 9371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:41.783188 9367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:41.783188 9364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:41.783376 9357 server_base.cc:1034] running on GCE node
I20260811 01:04:41.783643 9357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:41.783895 9357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:41.785060 9357 hybrid_clock.cc:648] HybridClock initialized: now 1786410281785038 us; error 35 us; skew 500 ppm
Aug 11 01:04:41 dist-test-slave-42z9 krb5kdc[9197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410281, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:41.787940 9357 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:04:41.788628 9357 webserver.cc:460] Webserver started at http://127.13.30.129:36257/ using document root <none> and password file <none>
I20260811 01:04:41.788908 9357 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:41.788960 9357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:41.789100 9357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:41.790498 9357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "55b3b80fe5714db18ce68a13194fae62"
format_stamp: "Formatted at 2026-08-11 01:04:41 on dist-test-slave-42z9"
server_key: "45ca48259a8fe2248e78c9c9860d4973"
server_key_iv: "7380c1757ed3a8e149e87d8b7d36b568"
server_key_version: "encryptionkey@0"
I20260811 01:04:41.791050 9357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "55b3b80fe5714db18ce68a13194fae62"
format_stamp: "Formatted at 2026-08-11 01:04:41 on dist-test-slave-42z9"
server_key: "45ca48259a8fe2248e78c9c9860d4973"
server_key_iv: "7380c1757ed3a8e149e87d8b7d36b568"
server_key_version: "encryptionkey@0"
I20260811 01:04:41.792932 9357 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260811 01:04:41.793980 9382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:41.794189 9357 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 01:04:41.794297 9357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "55b3b80fe5714db18ce68a13194fae62"
format_stamp: "Formatted at 2026-08-11 01:04:41 on dist-test-slave-42z9"
server_key: "45ca48259a8fe2248e78c9c9860d4973"
server_key_iv: "7380c1757ed3a8e149e87d8b7d36b568"
server_key_version: "encryptionkey@0"
I20260811 01:04:41.794386 9357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:41.802313 9357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:41.804527 9357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:41.804755 9357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:41.805008 9357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:41.805341 9357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:41.805377 9357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:41.805409 9357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:41.805426 9357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:41.811570 9357 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:32861
I20260811 01:04:41.811623 9564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:32861 every 8 connection(s)
I20260811 01:04:41.811968 9357 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
Aug 11 01:04:41 dist-test-slave-42z9 krb5kdc[9197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410281, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:04:41.821213 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 9357
I20260811 01:04:41.821321 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:04:41.821529 13434 external_mini_cluster.cc:1428] Setting key 6fe0620fb0a5c80ea452e3e3ac276359
I20260811 01:04:41.823247 9324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:41.812822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:36913 (local address 127.13.30.190:37495)
0811 01:04:41.812912 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:41.812914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:41.813092 (+ 178us) server_negotiation.cc:407] Connection header received
0811 01:04:41.813663 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:41.813664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:41.813674 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:41.813735 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:41.814820 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:41.815487 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:41.816666 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:41.816914 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:41.816993 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:41.820214 (+ 3221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:41.820216 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:41.820217 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:41.820227 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:41.821741 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:41.822232 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:41.822233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:41.822233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:41.822302 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:41.822596 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:41.822597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:41.822597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:41.822707 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:41.822750 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:41.823096 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 01:04:41.823176 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:04:41.823516 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:41.812777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37495 (local address 127.13.30.129:36913)
0811 01:04:41.812965 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:41.813012 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:41.813575 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:41.813794 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:41.813798 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:41.814400 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:41.814625 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:41.814631 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:41.815642 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:41.815643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:41.816520 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:41.816523 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:41.817074 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:41.817076 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:41.817306 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:41.818078 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:04:41.818090 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:41.820082 (+ 1992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:41.821845 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:41.821857 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:41.821860 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:41.822162 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:41.822365 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:41.822366 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:41.822366 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:41.822532 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:41.822754 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:41.822761 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:41.822947 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 01:04:41.823077 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 01:04:41.823272 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":87,"threads_started":1}
I20260811 01:04:41.824097 9565 heartbeater.cc:347] Connected to a master server at 127.13.30.190:37495
I20260811 01:04:41.824223 9565 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:41.824442 9565 heartbeater.cc:511] Master 127.13.30.190:37495 requested a full tablet report, sending...
I20260811 01:04:41.824997 9257 ts_manager.cc:194] Registered new tserver with Master: 55b3b80fe5714db18ce68a13194fae62 (127.13.30.129:32861)
I20260811 01:04:41.825666 9257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:36913
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:04:41.849857 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37495
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:41.940555 9572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:41.940797 9572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:41.940824 9572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:41.942071 9572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:41.942109 9572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:41.942137 9572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:04:41.943674 9572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37495
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:41.943889 9572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:41.944087 9572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:04:41.949389 9572 server_base.cc:1034] running on GCE node
W20260811 01:04:41.949339 9583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:41.949345 9580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:41.949348 9579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:41.949800 9572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:41.950057 9572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:41.951195 9572 hybrid_clock.cc:648] HybridClock initialized: now 1786410281951179 us; error 28 us; skew 500 ppm
Aug 11 01:04:41 dist-test-slave-42z9 krb5kdc[9197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410281, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:41.953778 9572 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:04:41.954242 9572 webserver.cc:460] Webserver started at http://127.13.30.130:46609/ using document root <none> and password file <none>
I20260811 01:04:41.954491 9572 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:41.954545 9572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:41.954645 9572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:41.955739 9572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "17d2fc0c5ad0431d90cca5d1aac94dae"
format_stamp: "Formatted at 2026-08-11 01:04:41 on dist-test-slave-42z9"
server_key: "fee29445082cdc844c65c4e71ec0f9a7"
server_key_iv: "a503529979b1345a81ba6bcf562a6ceb"
server_key_version: "encryptionkey@0"
I20260811 01:04:41.956122 9572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "17d2fc0c5ad0431d90cca5d1aac94dae"
format_stamp: "Formatted at 2026-08-11 01:04:41 on dist-test-slave-42z9"
server_key: "fee29445082cdc844c65c4e71ec0f9a7"
server_key_iv: "a503529979b1345a81ba6bcf562a6ceb"
server_key_version: "encryptionkey@0"
I20260811 01:04:41.957667 9572 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:04:41.958885 9593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:41.959271 9572 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:41.959406 9572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "17d2fc0c5ad0431d90cca5d1aac94dae"
format_stamp: "Formatted at 2026-08-11 01:04:41 on dist-test-slave-42z9"
server_key: "fee29445082cdc844c65c4e71ec0f9a7"
server_key_iv: "a503529979b1345a81ba6bcf562a6ceb"
server_key_version: "encryptionkey@0"
I20260811 01:04:41.959524 9572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:41.975188 9572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:41.978201 9572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:41.978361 9572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:41.978691 9572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:41.979135 9572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:41.979172 9572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:41.979208 9572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:41.979226 9572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:41.986806 9572 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:39211
I20260811 01:04:41.986922 9761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:39211 every 8 connection(s)
I20260811 01:04:41.987293 9572 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
Aug 11 01:04:41 dist-test-slave-42z9 krb5kdc[9197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410281, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:04:41.996778 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 9572
I20260811 01:04:41.996896 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:04:41.997120 13434 external_mini_cluster.cc:1428] Setting key d4c8be6f2206f6ae664feecd34ead38d
I20260811 01:04:41.998297 9324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:41.988252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:60483 (local address 127.13.30.190:37495)
0811 01:04:41.988314 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:41.988316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:41.988562 (+ 246us) server_negotiation.cc:407] Connection header received
0811 01:04:41.989183 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:41.989184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:41.989199 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:41.989256 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:41.990411 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:41.990939 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:41.992021 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:41.992242 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:41.992302 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:41.994713 (+ 2411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:41.994715 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:41.994716 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:41.994725 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:41.996255 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:41.996813 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:41.996816 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:41.996816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:41.996975 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:41.997342 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:41.997344 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:41.997345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:41.997612 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:41.997705 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:41.998084 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 01:04:41.998209 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 01:04:41.998512 9765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:41.988177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37495 (local address 127.13.30.130:60483)
0811 01:04:41.988403 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:41.988470 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:41.989071 (+ 601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:41.989330 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:41.989333 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:41.990068 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:41.990299 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:41.990304 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:41.991034 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:41.991035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:41.991930 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:41.991933 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:41.992327 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:41.992328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:41.992468 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:41.993046 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:04:41.993055 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:41.994606 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:41.996348 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:41.996359 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:41.996362 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:41.996667 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:41.997063 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:41.997065 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:41.997065 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:41.997234 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:41.997701 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:41.997709 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:41.997901 (+ 192us) client_negotiation.cc:769] Sending connection context
0811 01:04:41.998027 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 01:04:41.998245 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":117,"threads_started":1}
I20260811 01:04:42.000509 9763 heartbeater.cc:347] Connected to a master server at 127.13.30.190:37495
I20260811 01:04:42.000649 9763 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:42.000855 9763 heartbeater.cc:511] Master 127.13.30.190:37495 requested a full tablet report, sending...
I20260811 01:04:42.001303 9257 ts_manager.cc:194] Registered new tserver with Master: 17d2fc0c5ad0431d90cca5d1aac94dae (127.13.30.130:39211)
I20260811 01:04:42.001749 9257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:60483
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:04:42.028143 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37495
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:42.115928 9771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:42.116170 9771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:42.116199 9771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:42.117586 9771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:42.117645 9771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:42.117676 9771 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:04:42.119328 9771 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:37495
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:42.119589 9771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:42.119843 9771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:42.125242 9780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:42.125277 9782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:42.125288 9777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:42.125312 9771 server_base.cc:1034] running on GCE node
I20260811 01:04:42.125723 9771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:42.125973 9771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:42.127117 9771 hybrid_clock.cc:648] HybridClock initialized: now 1786410282127102 us; error 32 us; skew 500 ppm
Aug 11 01:04:42 dist-test-slave-42z9 krb5kdc[9197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410282, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:42.130156 9771 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:04:42.130686 9771 webserver.cc:460] Webserver started at http://127.13.30.131:38803/ using document root <none> and password file <none>
I20260811 01:04:42.131000 9771 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:42.131052 9771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:42.131158 9771 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:42.132222 9771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "fa8483c596454cf5a12126fdaab32743"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "9a1c99ca9a768485e5454a9e8b7aaa8c"
server_key_iv: "84c8f099ceadaed8310aeac28d3ca7f8"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.132535 9771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "fa8483c596454cf5a12126fdaab32743"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "9a1c99ca9a768485e5454a9e8b7aaa8c"
server_key_iv: "84c8f099ceadaed8310aeac28d3ca7f8"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.134042 9771 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:04:42.135033 9791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:42.135300 9771 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:42.135408 9771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "fa8483c596454cf5a12126fdaab32743"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "9a1c99ca9a768485e5454a9e8b7aaa8c"
server_key_iv: "84c8f099ceadaed8310aeac28d3ca7f8"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.135485 9771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:42.147643 9771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:42.149695 9771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:42.149848 9771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:42.150122 9771 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:42.150454 9771 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:42.150489 9771 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:42.150520 9771 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:42.150543 9771 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:42.157079 9771 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:37989
I20260811 01:04:42.157135 9965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:37989 every 8 connection(s)
I20260811 01:04:42.157517 9771 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
Aug 11 01:04:42 dist-test-slave-42z9 krb5kdc[9197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410282, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:04:42.164815 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 9771
I20260811 01:04:42.164920 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:04:42.165104 13434 external_mini_cluster.cc:1428] Setting key b036b3e0b05caeafcf6f60b4a15080a6
I20260811 01:04:42.167775 9324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.158335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:41429 (local address 127.13.30.190:37495)
0811 01:04:42.158418 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.158420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.158629 (+ 209us) server_negotiation.cc:407] Connection header received
0811 01:04:42.159156 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.159157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.159168 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.159227 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:42.160214 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.160733 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.161778 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.162058 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.162132 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.164658 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:42.164660 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:42.164660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:42.164667 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:42.166316 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:42.166785 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:42.166786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:42.166786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:42.166851 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:42.167072 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:42.167073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:42.167073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:42.167189 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:42.167241 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.167617 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.167696 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 01:04:42.167904 9968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.158314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:37495 (local address 127.13.30.131:41429)
0811 01:04:42.158507 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:42.158546 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:42.159045 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:42.159281 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:42.159285 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:42.159892 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:42.160111 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.160116 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.160814 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.160815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.161699 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.161702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.162179 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.162180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.162304 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.162962 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:04:42.162972 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:42.164546 (+ 1574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:42.166411 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:42.166420 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:42.166423 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:42.166692 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:42.166914 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:42.166915 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:42.166915 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:42.167021 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:42.167267 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:42.167275 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:42.167425 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 01:04:42.167541 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 01:04:42.167700 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":110,"threads_started":1}
I20260811 01:04:42.168395 9966 heartbeater.cc:347] Connected to a master server at 127.13.30.190:37495
I20260811 01:04:42.168493 9966 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:42.168670 9966 heartbeater.cc:511] Master 127.13.30.190:37495 requested a full tablet report, sending...
I20260811 01:04:42.169025 9257 ts_manager.cc:194] Registered new tserver with Master: fa8483c596454cf5a12126fdaab32743 (127.13.30.131:37989)
I20260811 01:04:42.169382 9257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:41429
I20260811 01:04:42.177474 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:04:42.185202 9324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.179181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42732 (local address 127.13.30.190:37495)
0811 01:04:42.179237 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.179239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.179278 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:04:42.179363 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.179363 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.179373 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.179437 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:42.180040 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.180555 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.181314 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.181550 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.181600 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.182849 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:42.182851 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:42.182851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:42.182858 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:42.184189 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:42.184507 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:42.184508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:42.184509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:42.184561 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:42.184709 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:42.184710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:42.184710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:42.184877 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:42.184958 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.185048 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.185121 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 01:04:42.186959 9257 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42732:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:04:42.189311 9257 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:04:42.198153 9987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.193232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46112 (local address 127.13.30.130:39211)
0811 01:04:42.193510 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.193516 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.193677 (+ 161us) server_negotiation.cc:407] Connection header received
0811 01:04:42.193869 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.193872 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.193893 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.193975 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:42.194311 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.195578 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.196994 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.197764 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.197849 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.197924 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.198002 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.198051 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":86,"threads_started":1}
I20260811 01:04:42.198161 9986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.192916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:39211 (local address 127.0.0.1:46112)
0811 01:04:42.193588 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:42.193600 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:42.193713 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:42.194096 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:42.194100 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:42.194103 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:42.194225 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.194229 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.195804 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.195806 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.196894 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.196897 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.197845 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.197846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.197918 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.197925 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 01:04:42.197984 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 01:04:42.198051 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"mutex_wait_us":31,"thread_start_us":86,"threads_started":1}
I20260811 01:04:42.198472 9985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.193120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59118 (local address 127.13.30.129:32861)
0811 01:04:42.193352 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.193358 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.193593 (+ 235us) server_negotiation.cc:407] Connection header received
0811 01:04:42.193868 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.193872 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.193893 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.193962 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:42.194355 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.195179 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.196648 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.197505 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.197618 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.197695 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.198206 (+ 511us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.198382 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":120,"threads_started":1}
I20260811 01:04:42.198598 9983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.193170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:37989 (local address 127.0.0.1:38226)
0811 01:04:42.193809 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:42.193822 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:42.193975 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:42.194190 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:42.194192 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:42.194195 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:42.194278 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.194281 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.195752 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.195754 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.196825 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.196829 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.198247 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.198248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.198318 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.198323 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:04:42.198389 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 01:04:42.198435 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"mutex_wait_us":85,"thread_start_us":74,"threads_started":1}
I20260811 01:04:42.198125 9984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.192917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:32861 (local address 127.0.0.1:59118)
0811 01:04:42.193380 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:42.193428 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:42.193713 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:42.194129 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:42.194130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:42.194132 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:42.194225 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.194229 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.195298 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.195299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.196539 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.196543 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.197739 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.197740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.197835 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.197853 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 01:04:42.197922 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 01:04:42.197997 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"mutex_wait_us":6,"spinlock_wait_cycles":768,"thread_start_us":110,"threads_started":1}
I20260811 01:04:42.199033 9988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.193404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38226 (local address 127.13.30.131:37989)
0811 01:04:42.193636 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.193640 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.193940 (+ 300us) server_negotiation.cc:407] Connection header received
0811 01:04:42.194083 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.194086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.194105 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.194186 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:42.194423 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.195589 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.196940 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.197769 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.197841 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.197895 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.198896 (+ 1001us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.198957 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":125,"threads_started":1}
I20260811 01:04:42.199364 9653 tablet_service.cc:1467] Processing CreateTablet for tablet dfb75a6e7efc4916a7755490b68b7c50 (DEFAULT_TABLE table=test-table [id=3f540f0bf4e94de09f7b78d92eb30db5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:42.199764 9653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfb75a6e7efc4916a7755490b68b7c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:42.199836 9861 tablet_service.cc:1467] Processing CreateTablet for tablet dfb75a6e7efc4916a7755490b68b7c50 (DEFAULT_TABLE table=test-table [id=3f540f0bf4e94de09f7b78d92eb30db5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:42.200147 9861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfb75a6e7efc4916a7755490b68b7c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:42.202293 9455 tablet_service.cc:1467] Processing CreateTablet for tablet dfb75a6e7efc4916a7755490b68b7c50 (DEFAULT_TABLE table=test-table [id=3f540f0bf4e94de09f7b78d92eb30db5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:42.202802 9455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfb75a6e7efc4916a7755490b68b7c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:42.202986 9989 tablet_bootstrap.cc:492] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae: Bootstrap starting.
I20260811 01:04:42.203256 9990 tablet_bootstrap.cc:492] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743: Bootstrap starting.
I20260811 01:04:42.203794 9989 tablet_bootstrap.cc:654] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:42.203878 9990 tablet_bootstrap.cc:654] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:42.204428 9990 log.cc:824] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:42.204440 9989 log.cc:824] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:42.205209 9989 tablet_bootstrap.cc:492] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae: No bootstrap required, opened a new log
I20260811 01:04:42.205268 9989 ts_tablet_manager.cc:1397] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:04:42.205714 9990 tablet_bootstrap.cc:492] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743: No bootstrap required, opened a new log
I20260811 01:04:42.205790 9990 ts_tablet_manager.cc:1397] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 01:04:42.205971 9994 tablet_bootstrap.cc:492] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62: Bootstrap starting.
I20260811 01:04:42.206598 9994 tablet_bootstrap.cc:654] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:42.207072 9994 log.cc:824] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:42.207351 9989 raft_consensus.cc:348] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d2fc0c5ad0431d90cca5d1aac94dae" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39211 } } peers { permanent_uuid: "fa8483c596454cf5a12126fdaab32743" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 37989 } } peers { permanent_uuid: "55b3b80fe5714db18ce68a13194fae62" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32861 } }
I20260811 01:04:42.207549 9989 raft_consensus.cc:374] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:42.207593 9989 raft_consensus.cc:729] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d2fc0c5ad0431d90cca5d1aac94dae, State: Initialized, Role: FOLLOWER
I20260811 01:04:42.207777 9994 tablet_bootstrap.cc:492] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62: No bootstrap required, opened a new log
I20260811 01:04:42.207751 9989 consensus_queue.cc:260] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d2fc0c5ad0431d90cca5d1aac94dae" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39211 } } peers { permanent_uuid: "fa8483c596454cf5a12126fdaab32743" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 37989 } } peers { permanent_uuid: "55b3b80fe5714db18ce68a13194fae62" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32861 } }
I20260811 01:04:42.207849 9994 ts_tablet_manager.cc:1397] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:04:42.208050 9989 ts_tablet_manager.cc:1428] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:04:42.208204 9763 heartbeater.cc:503] Master 127.13.30.190:37495 was elected leader, sending a full tablet report...
I20260811 01:04:42.208107 9990 raft_consensus.cc:348] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d2fc0c5ad0431d90cca5d1aac94dae" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39211 } } peers { permanent_uuid: "fa8483c596454cf5a12126fdaab32743" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 37989 } } peers { permanent_uuid: "55b3b80fe5714db18ce68a13194fae62" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32861 } }
I20260811 01:04:42.208266 9990 raft_consensus.cc:374] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:42.208307 9990 raft_consensus.cc:729] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8483c596454cf5a12126fdaab32743, State: Initialized, Role: FOLLOWER
I20260811 01:04:42.208412 9990 consensus_queue.cc:260] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d2fc0c5ad0431d90cca5d1aac94dae" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39211 } } peers { permanent_uuid: "fa8483c596454cf5a12126fdaab32743" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 37989 } } peers { permanent_uuid: "55b3b80fe5714db18ce68a13194fae62" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32861 } }
I20260811 01:04:42.208704 9990 ts_tablet_manager.cc:1428] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 01:04:42.208828 9966 heartbeater.cc:503] Master 127.13.30.190:37495 was elected leader, sending a full tablet report...
I20260811 01:04:42.210176 9994 raft_consensus.cc:348] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d2fc0c5ad0431d90cca5d1aac94dae" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39211 } } peers { permanent_uuid: "fa8483c596454cf5a12126fdaab32743" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 37989 } } peers { permanent_uuid: "55b3b80fe5714db18ce68a13194fae62" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32861 } }
I20260811 01:04:42.210362 9994 raft_consensus.cc:374] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:42.210409 9994 raft_consensus.cc:729] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55b3b80fe5714db18ce68a13194fae62, State: Initialized, Role: FOLLOWER
I20260811 01:04:42.210546 9994 consensus_queue.cc:260] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d2fc0c5ad0431d90cca5d1aac94dae" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39211 } } peers { permanent_uuid: "fa8483c596454cf5a12126fdaab32743" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 37989 } } peers { permanent_uuid: "55b3b80fe5714db18ce68a13194fae62" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32861 } }
I20260811 01:04:42.210814 9994 ts_tablet_manager.cc:1428] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:04:42.210850 9565 heartbeater.cc:503] Master 127.13.30.190:37495 was elected leader, sending a full tablet report...
I20260811 01:04:42.215906 9997 raft_consensus.cc:482] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:04:42.216137 9997 raft_consensus.cc:504] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d2fc0c5ad0431d90cca5d1aac94dae" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39211 } } peers { permanent_uuid: "fa8483c596454cf5a12126fdaab32743" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 37989 } } peers { permanent_uuid: "55b3b80fe5714db18ce68a13194fae62" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32861 } }
I20260811 01:04:42.216637 9997 leader_election.cc:288] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17d2fc0c5ad0431d90cca5d1aac94dae (127.13.30.130:39211), 55b3b80fe5714db18ce68a13194fae62 (127.13.30.129:32861)
I20260811 01:04:42.219708 9968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.216831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:39211 (local address 127.13.30.131:47463)
0811 01:04:42.216941 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:42.216956 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:42.217010 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:42.217165 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:42.217166 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:42.217168 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:42.217260 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.217262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.218000 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.218001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.218820 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.218822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.219422 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.219424 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.219511 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.219514 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:04:42.219560 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:04:42.219614 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 01:04:42.219708 9987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.216923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:47463 (local address 127.13.30.130:39211)
0811 01:04:42.216985 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.216988 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.217002 (+ 14us) server_negotiation.cc:407] Connection header received
0811 01:04:42.217084 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.217085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.217099 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.217171 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:42.217333 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.217917 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.218907 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.219350 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.219415 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.219427 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.219572 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.219624 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 01:04:42.220403 10003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.216878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:32861 (local address 127.13.30.131:43089)
0811 01:04:42.217261 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:42.217270 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:42.217330 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:42.217508 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:42.217509 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:42.217511 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:42.217589 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.217591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.218533 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.218536 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.219416 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.219418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.220116 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.220117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.220202 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.220208 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 01:04:42.220271 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 01:04:42.220321 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":168,"threads_started":1}
I20260811 01:04:42.220400 9985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.216936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:43089 (local address 127.13.30.129:32861)
0811 01:04:42.217092 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.217094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.217341 (+ 247us) server_negotiation.cc:407] Connection header received
0811 01:04:42.217395 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.217396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.217411 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.217481 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:42.217650 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.218324 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.219526 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.220021 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.220109 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.220122 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.220285 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.220331 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260811 01:04:42.220346 9687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfb75a6e7efc4916a7755490b68b7c50" candidate_uuid: "fa8483c596454cf5a12126fdaab32743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d2fc0c5ad0431d90cca5d1aac94dae" is_pre_election: true
I20260811 01:04:42.220564 9687 raft_consensus.cc:2454] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8483c596454cf5a12126fdaab32743 in term 0.
I20260811 01:04:42.220803 9488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfb75a6e7efc4916a7755490b68b7c50" candidate_uuid: "fa8483c596454cf5a12126fdaab32743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55b3b80fe5714db18ce68a13194fae62" is_pre_election: true
I20260811 01:04:42.220899 9799 leader_election.cc:302] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d2fc0c5ad0431d90cca5d1aac94dae, fa8483c596454cf5a12126fdaab32743; no voters:
I20260811 01:04:42.220995 9488 raft_consensus.cc:2454] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8483c596454cf5a12126fdaab32743 in term 0.
I20260811 01:04:42.221086 9997 raft_consensus.cc:2781] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:04:42.221201 9997 raft_consensus.cc:482] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:04:42.221233 9997 raft_consensus.cc:3037] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:42.222133 9997 raft_consensus.cc:504] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d2fc0c5ad0431d90cca5d1aac94dae" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39211 } } peers { permanent_uuid: "fa8483c596454cf5a12126fdaab32743" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 37989 } } peers { permanent_uuid: "55b3b80fe5714db18ce68a13194fae62" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32861 } }
I20260811 01:04:42.222321 9997 leader_election.cc:288] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [CANDIDATE]: Term 1 election: Requested vote from peers 17d2fc0c5ad0431d90cca5d1aac94dae (127.13.30.130:39211), 55b3b80fe5714db18ce68a13194fae62 (127.13.30.129:32861)
I20260811 01:04:42.222540 9488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfb75a6e7efc4916a7755490b68b7c50" candidate_uuid: "fa8483c596454cf5a12126fdaab32743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55b3b80fe5714db18ce68a13194fae62"
I20260811 01:04:42.222668 9488 raft_consensus.cc:3037] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:42.223470 9488 raft_consensus.cc:2454] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8483c596454cf5a12126fdaab32743 in term 1.
I20260811 01:04:42.223609 9687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfb75a6e7efc4916a7755490b68b7c50" candidate_uuid: "fa8483c596454cf5a12126fdaab32743" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d2fc0c5ad0431d90cca5d1aac94dae"
I20260811 01:04:42.223721 9792 leader_election.cc:302] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55b3b80fe5714db18ce68a13194fae62, fa8483c596454cf5a12126fdaab32743; no voters:
I20260811 01:04:42.223740 9687 raft_consensus.cc:3037] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:42.223908 9997 raft_consensus.cc:2781] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:42.224151 9997 raft_consensus.cc:686] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [term 1 LEADER]: Becoming Leader. State: Replica: fa8483c596454cf5a12126fdaab32743, State: Running, Role: LEADER
I20260811 01:04:42.224311 9997 consensus_queue.cc:237] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d2fc0c5ad0431d90cca5d1aac94dae" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39211 } } peers { permanent_uuid: "fa8483c596454cf5a12126fdaab32743" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 37989 } } peers { permanent_uuid: "55b3b80fe5714db18ce68a13194fae62" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32861 } }
I20260811 01:04:42.224689 9687 raft_consensus.cc:2454] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8483c596454cf5a12126fdaab32743 in term 1.
I20260811 01:04:42.225728 9257 catalog_manager.cc:5495] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8483c596454cf5a12126fdaab32743 (127.13.30.131). New cstate: current_term: 1 leader_uuid: "fa8483c596454cf5a12126fdaab32743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d2fc0c5ad0431d90cca5d1aac94dae" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8483c596454cf5a12126fdaab32743" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 37989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55b3b80fe5714db18ce68a13194fae62" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32861 } health_report { overall_health: UNKNOWN } } }
I20260811 01:04:42.236588 9988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.233541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38242 (local address 127.13.30.131:37989)
0811 01:04:42.233616 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.233619 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.233632 (+ 13us) server_negotiation.cc:407] Connection header received
0811 01:04:42.233678 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.233679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.233708 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.233786 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:04:42.233904 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.234441 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.235360 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.235618 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.235694 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.236016 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:04:42.236144 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:04:42.236224 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.236382 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.236428 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260811 01:04:42.237989 9764 tablet.cc:2369] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:04:42.239312 9687 raft_consensus.cc:1261] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae [term 1 FOLLOWER]: Refusing update from remote peer fa8483c596454cf5a12126fdaab32743: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:04:42.239315 9488 raft_consensus.cc:1261] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62 [term 1 FOLLOWER]: Refusing update from remote peer fa8483c596454cf5a12126fdaab32743: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:04:42.239861 10004 consensus_queue.cc:1035] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d2fc0c5ad0431d90cca5d1aac94dae" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:04:42.240115 9997 consensus_queue.cc:1035] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55b3b80fe5714db18ce68a13194fae62" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:04:42.245157 10011 mvcc.cc:205] Tried to move back new op lower bound from 7317136516048433152 to 7317136515991797760. Current Snapshot: MvccSnapshot[applied={T|T < 7317136516048433152}]
I20260811 01:04:42.245628 9257 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42732:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:04:42.245738 9257 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42732:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:04:42.246763 9257 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 00e6687a9175430ea8041fd574559e7b: Sending DeleteTablet for 3 replicas of tablet dfb75a6e7efc4916a7755490b68b7c50
I20260811 01:04:42.247252 9455 tablet_service.cc:1514] Processing DeleteTablet for tablet dfb75a6e7efc4916a7755490b68b7c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:42 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:59118
I20260811 01:04:42.247375 9653 tablet_service.cc:1514] Processing DeleteTablet for tablet dfb75a6e7efc4916a7755490b68b7c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:42 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:46112
I20260811 01:04:42.247520 9861 tablet_service.cc:1514] Processing DeleteTablet for tablet dfb75a6e7efc4916a7755490b68b7c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:42 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:38226
I20260811 01:04:42.247798 10025 tablet_replica.cc:330] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62: stopping tablet replica
I20260811 01:04:42.247834 10027 tablet_replica.cc:330] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743: stopping tablet replica
I20260811 01:04:42.247925 10025 raft_consensus.cc:2229] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:42.248075 10025 raft_consensus.cc:2258] T dfb75a6e7efc4916a7755490b68b7c50 P 55b3b80fe5714db18ce68a13194fae62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:42.248167 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 9357
I20260811 01:04:42.261611 10026 tablet_replica.cc:330] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae: stopping tablet replica
I20260811 01:04:42.261793 10026 raft_consensus.cc:2229] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:42.261915 10026 raft_consensus.cc:2258] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:42.262658 10026 ts_tablet_manager.cc:1905] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:42.276502 10026 ts_tablet_manager.cc:1918] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:42.276764 10026 log.cc:1196] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/dfb75a6e7efc4916a7755490b68b7c50
I20260811 01:04:42.277294 10026 ts_tablet_manager.cc:1939] T dfb75a6e7efc4916a7755490b68b7c50 P 17d2fc0c5ad0431d90cca5d1aac94dae: Deleting consensus metadata
I20260811 01:04:42.278136 9244 catalog_manager.cc:4841] TS 17d2fc0c5ad0431d90cca5d1aac94dae (127.13.30.130:39211): tablet dfb75a6e7efc4916a7755490b68b7c50 (table test-table [id=3f540f0bf4e94de09f7b78d92eb30db5]) successfully deleted
I20260811 01:04:42.278498 10027 raft_consensus.cc:2229] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:04:42.278755 10027 raft_consensus.cc:2258] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:42.280674 10027 ts_tablet_manager.cc:1905] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:42.282914 10027 ts_tablet_manager.cc:1918] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:42.283092 10027 log.cc:1196] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/dfb75a6e7efc4916a7755490b68b7c50
I20260811 01:04:42.283512 10027 ts_tablet_manager.cc:1939] T dfb75a6e7efc4916a7755490b68b7c50 P fa8483c596454cf5a12126fdaab32743: Deleting consensus metadata
I20260811 01:04:42.284184 9244 catalog_manager.cc:4841] TS fa8483c596454cf5a12126fdaab32743 (127.13.30.131:37989): tablet dfb75a6e7efc4916a7755490b68b7c50 (table test-table [id=3f540f0bf4e94de09f7b78d92eb30db5]) successfully deleted
W20260811 01:04:42.296974 9238 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:32861 (error 108)
I20260811 01:04:42.297219 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 9572
I20260811 01:04:42.304201 9984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.304032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:32861 (local address 127.0.0.1:59128)
0811 01:04:42.304101 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:42.304149 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:32861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 01:04:42.304368 9238 catalog_manager.cc:4584] TS 55b3b80fe5714db18ce68a13194fae62 (127.13.30.129:32861): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dfb75a6e7efc4916a7755490b68b7c50: Network error: Client connection negotiation failed: client connection to 127.13.30.129:32861: connect: Connection refused (error 111)
I20260811 01:04:42.309721 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 9771
I20260811 01:04:42.326964 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 9215
2026-08-11T01:04:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2160 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T01:04:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:04:42Z Disabled control of system clock
I20260811 01:04:42.370433 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:42281
--webserver_interface=127.13.30.190
--webserver_port=0
--builtin_ntp_servers=127.13.30.148:36057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:42281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:04:42.457873 10036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:42.458124 10036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:42.458148 10036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:42.459383 10036 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:04:42.459424 10036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:42.459435 10036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:42.459447 10036 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:04:42.459460 10036 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:04:42.460906 10036 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:42281
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:42281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:42.461138 10036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:42.461472 10036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:42.466302 10047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:42.466302 10054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:42.466328 10052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:42.466766 10036 server_base.cc:1034] running on GCE node
I20260811 01:04:42.466984 10036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:42.467248 10036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:42.468420 10036 hybrid_clock.cc:648] HybridClock initialized: now 1786410282468405 us; error 32 us; skew 500 ppm
I20260811 01:04:42.469820 10036 webserver.cc:460] Webserver started at http://127.13.30.190:38339/ using document root <none> and password file <none>
I20260811 01:04:42.470063 10036 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:42.470110 10036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:42.470245 10036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:42.471403 10036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "0c7244fa5ea94ccf8fc1ac92d2342742"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "f2b1d8442a0fcb4904a107c206aa9c41"
server_key_iv: "235c663f395a34a48ef2e493fd279cf0"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.471747 10036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "0c7244fa5ea94ccf8fc1ac92d2342742"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "f2b1d8442a0fcb4904a107c206aa9c41"
server_key_iv: "235c663f395a34a48ef2e493fd279cf0"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.473500 10036 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 01:04:42.474520 10064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:42.474758 10036 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:42.474850 10036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "0c7244fa5ea94ccf8fc1ac92d2342742"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "f2b1d8442a0fcb4904a107c206aa9c41"
server_key_iv: "235c663f395a34a48ef2e493fd279cf0"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.474932 10036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:42.494072 10036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:42.494431 10036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:42.494580 10036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:42.498931 10036 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:42281
I20260811 01:04:42.498976 10142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:42281 every 8 connection(s)
I20260811 01:04:42.499361 10036 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:04:42.500442 10143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:42.502918 10143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742: Bootstrap starting.
I20260811 01:04:42.503580 10143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:42.503865 10143 log.cc:824] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:42.504628 10143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742: No bootstrap required, opened a new log
I20260811 01:04:42.506342 10143 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7244fa5ea94ccf8fc1ac92d2342742" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42281 } }
I20260811 01:04:42.506497 10143 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:42.506520 10143 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7244fa5ea94ccf8fc1ac92d2342742, State: Initialized, Role: FOLLOWER
I20260811 01:04:42.506500 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 10036
I20260811 01:04:42.506592 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:04:42.506698 10143 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7244fa5ea94ccf8fc1ac92d2342742" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42281 } }
I20260811 01:04:42.506760 13434 external_mini_cluster.cc:1428] Setting key d89bf26e0025e1632e8b2de82c80b66b
I20260811 01:04:42.506774 10143 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:04:42.506798 10143 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:04:42.506846 10143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:42.507503 10143 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7244fa5ea94ccf8fc1ac92d2342742" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42281 } }
I20260811 01:04:42.507611 10143 leader_election.cc:302] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c7244fa5ea94ccf8fc1ac92d2342742; no voters:
I20260811 01:04:42.507772 10143 leader_election.cc:288] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:04:42.507822 10153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:42.507985 10153 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7244fa5ea94ccf8fc1ac92d2342742, State: Running, Role: LEADER
I20260811 01:04:42.508044 10143 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:04:42.508087 10153 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7244fa5ea94ccf8fc1ac92d2342742" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42281 } }
I20260811 01:04:42.508530 10154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c7244fa5ea94ccf8fc1ac92d2342742" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7244fa5ea94ccf8fc1ac92d2342742" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42281 } } }
I20260811 01:04:42.508646 10154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:42.508635 10153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c7244fa5ea94ccf8fc1ac92d2342742. Latest consensus state: current_term: 1 leader_uuid: "0c7244fa5ea94ccf8fc1ac92d2342742" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7244fa5ea94ccf8fc1ac92d2342742" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42281 } } }
I20260811 01:04:42.508874 10153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742 [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:42.509007 10164 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:04:42.509569 10164 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:04:42.511102 10164 catalog_manager.cc:1347] Generated new cluster ID: f3aaa6edd932451199150d849b525bc4
I20260811 01:04:42.511152 10164 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:04:42.513479 10150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.507264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40284 (local address 127.13.30.190:42281)
0811 01:04:42.507512 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.507520 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.507546 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:04:42.507657 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.507664 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.507735 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.508184 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:42.508303 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.510086 (+ 1783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.511227 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.511816 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.511940 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.512685 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:42.512690 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:42.512690 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:42.512916 (+ 226us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:42.512990 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:42.513007 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:42.513080 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.513137 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.513229 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":125,"threads_started":1}
I20260811 01:04:42.525157 10164 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:04:42.525786 10164 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:04:42.534682 10164 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742: Generated new TSK 0
I20260811 01:04:42.535012 10164 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:04:42.540599 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42281
--builtin_ntp_servers=127.13.30.148:36057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:04:42.631496 10180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:42.631747 10180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:42.631772 10180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:42.633040 10180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:42.633088 10180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:42.633116 10180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:04:42.634614 10180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:42.634871 10180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:42.635222 10180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:42.641635 10194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:42.641697 10180 server_base.cc:1034] running on GCE node
W20260811 01:04:42.641624 10197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:42.641875 10193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:42.642131 10180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:42.642392 10180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:42.643556 10180 hybrid_clock.cc:648] HybridClock initialized: now 1786410282643546 us; error 40 us; skew 500 ppm
I20260811 01:04:42.645115 10180 webserver.cc:460] Webserver started at http://127.13.30.129:38373/ using document root <none> and password file <none>
I20260811 01:04:42.645380 10180 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:42.645431 10180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:42.645601 10180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:42.646788 10180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "e3efe84cddad49c7b25e5019c09069d9"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "8f6dff4f3ad5af1907fd546341aaea61"
server_key_iv: "9ac7f3a8af96ec2c899b9a3faef1fff6"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.647135 10180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "e3efe84cddad49c7b25e5019c09069d9"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "8f6dff4f3ad5af1907fd546341aaea61"
server_key_iv: "9ac7f3a8af96ec2c899b9a3faef1fff6"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.648662 10180 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:04:42.649653 10207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:42.649904 10180 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:42.650024 10180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "e3efe84cddad49c7b25e5019c09069d9"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "8f6dff4f3ad5af1907fd546341aaea61"
server_key_iv: "9ac7f3a8af96ec2c899b9a3faef1fff6"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.650133 10180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:42.659683 10180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:42.660066 10180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:42.660204 10180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:42.660476 10180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:42.660871 10180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:42.660918 10180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:42.660943 10180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:42.660953 10180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:42.666822 10180 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:41645
I20260811 01:04:42.666885 10379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:41645 every 8 connection(s)
I20260811 01:04:42.667222 10180 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:04:42.672518 10150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.668044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:52841 (local address 127.13.30.190:42281)
0811 01:04:42.668093 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.668095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.668329 (+ 234us) server_negotiation.cc:407] Connection header received
0811 01:04:42.668866 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.668867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.668881 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.668931 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:42.669680 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.670198 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.671230 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.671438 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.671506 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.672290 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:42.672291 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:42.672291 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:42.672299 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:42.672314 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:42.672318 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:42.672359 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.672413 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.672444 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 01:04:42.672711 10383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.668022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42281 (local address 127.13.30.129:52841)
0811 01:04:42.668208 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:42.668245 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:42.668775 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:42.668997 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:42.669001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:42.669010 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:42.669602 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.669608 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.670271 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.670272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.671124 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.671127 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.671515 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.671516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.671630 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.672155 (+ 525us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:04:42.672155 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:42.672187 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:04:42.672214 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:42.672358 (+ 144us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:42.672361 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:42.672363 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 01:04:42.672408 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 01:04:42.672505 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":91,"threads_started":1}
I20260811 01:04:42.673213 10380 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42281
I20260811 01:04:42.673313 10380 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:42.673537 10380 heartbeater.cc:511] Master 127.13.30.190:42281 requested a full tablet report, sending...
I20260811 01:04:42.674079 10095 ts_manager.cc:194] Registered new tserver with Master: e3efe84cddad49c7b25e5019c09069d9 (127.13.30.129:41645)
I20260811 01:04:42.674696 10095 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.30.129:52841
I20260811 01:04:42.676973 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 10180
I20260811 01:04:42.677063 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:04:42.677215 13434 external_mini_cluster.cc:1428] Setting key a547d56510ff85332dd77e496b80c04b
I20260811 01:04:42.678164 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42281
--builtin_ntp_servers=127.13.30.148:36057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:04:42.764906 10385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:42.765136 10385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:42.765166 10385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:42.766412 10385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:42.766462 10385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:42.766497 10385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:04:42.767928 10385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:42.768193 10385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:42.768502 10385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:42.773636 10394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:42.773783 10385 server_base.cc:1034] running on GCE node
W20260811 01:04:42.773674 10395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:42.773644 10398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:42.774087 10385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:42.774317 10385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:42.775454 10385 hybrid_clock.cc:648] HybridClock initialized: now 1786410282775446 us; error 38 us; skew 500 ppm
I20260811 01:04:42.776733 10385 webserver.cc:460] Webserver started at http://127.13.30.130:36687/ using document root <none> and password file <none>
I20260811 01:04:42.776965 10385 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:42.777016 10385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:42.777144 10385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:42.778404 10385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "3806eec6cd924b3984ef7dc5ba89b81c"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "90f29a48b5486251f8a9f047bb366c88"
server_key_iv: "ae2274145e749a15d361c16f40cd3bad"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.778766 10385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "3806eec6cd924b3984ef7dc5ba89b81c"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "90f29a48b5486251f8a9f047bb366c88"
server_key_iv: "ae2274145e749a15d361c16f40cd3bad"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.780157 10385 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:04:42.780882 10406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:42.781054 10385 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:04:42.781155 10385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "3806eec6cd924b3984ef7dc5ba89b81c"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "90f29a48b5486251f8a9f047bb366c88"
server_key_iv: "ae2274145e749a15d361c16f40cd3bad"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.781227 10385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:42.792477 10385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:42.792832 10385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:42.792969 10385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:42.793216 10385 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:42.793629 10385 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:42.793670 10385 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:42.793701 10385 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:42.793725 10385 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:42.800103 10385 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:37377
I20260811 01:04:42.800159 10592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:37377 every 8 connection(s)
I20260811 01:04:42.800509 10385 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:04:42.804251 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 10385
I20260811 01:04:42.804371 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:04:42.804577 13434 external_mini_cluster.cc:1428] Setting key bad8b0629f62487bd283da6d911c46a2
I20260811 01:04:42.805584 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42281
--builtin_ntp_servers=127.13.30.148:36057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 01:04:42.806100 10150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.801231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:57513 (local address 127.13.30.190:42281)
0811 01:04:42.801319 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.801321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.801574 (+ 253us) server_negotiation.cc:407] Connection header received
0811 01:04:42.802110 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.802112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.802123 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.802177 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:42.802854 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.803356 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.804460 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.804713 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.804780 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.805845 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:42.805846 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:42.805847 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:42.805852 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:42.805869 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:42.805874 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:42.805929 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.805997 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.806026 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 01:04:42.806313 10597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.801202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42281 (local address 127.13.30.130:57513)
0811 01:04:42.801411 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:42.801482 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:42.802004 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:42.802242 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:42.802245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:42.802253 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:42.802756 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.802760 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.803427 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.803428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.804380 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.804386 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.804804 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.804805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.804937 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.805685 (+ 748us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:04:42.805686 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:42.805734 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:04:42.805765 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:42.805941 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:42.805944 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:42.805947 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:04:42.805997 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 01:04:42.806087 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":93,"threads_started":1}
I20260811 01:04:42.806775 10593 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42281
I20260811 01:04:42.806874 10593 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:42.807058 10593 heartbeater.cc:511] Master 127.13.30.190:42281 requested a full tablet report, sending...
I20260811 01:04:42.807420 10095 ts_manager.cc:194] Registered new tserver with Master: 3806eec6cd924b3984ef7dc5ba89b81c (127.13.30.130:37377)
I20260811 01:04:42.807789 10095 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.30.130:57513
W20260811 01:04:42.893509 10599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:42.893731 10599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:42.893755 10599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:42.894915 10599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:42.894955 10599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:42.894981 10599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:04:42.896345 10599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:36057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:42281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:42.896557 10599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:42.896840 10599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:42.901953 10605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:42.901942 10604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:42.901926 10607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:42.902189 10599 server_base.cc:1034] running on GCE node
I20260811 01:04:42.902411 10599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:42.902622 10599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:42.903774 10599 hybrid_clock.cc:648] HybridClock initialized: now 1786410282903751 us; error 35 us; skew 500 ppm
I20260811 01:04:42.905118 10599 webserver.cc:460] Webserver started at http://127.13.30.131:36027/ using document root <none> and password file <none>
I20260811 01:04:42.905387 10599 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:42.905462 10599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:42.905609 10599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:42.906755 10599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "e561a169023f46ef8db704122960a496"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "151de0d6f574b4d13f10dded16552bf7"
server_key_iv: "775840923a76996a9a3421365fc30ff9"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.907104 10599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "e561a169023f46ef8db704122960a496"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "151de0d6f574b4d13f10dded16552bf7"
server_key_iv: "775840923a76996a9a3421365fc30ff9"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.908516 10599 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:04:42.909260 10620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:42.909432 10599 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 01:04:42.909543 10599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "e561a169023f46ef8db704122960a496"
format_stamp: "Formatted at 2026-08-11 01:04:42 on dist-test-slave-42z9"
server_key: "151de0d6f574b4d13f10dded16552bf7"
server_key_iv: "775840923a76996a9a3421365fc30ff9"
server_key_version: "encryptionkey@0"
I20260811 01:04:42.909613 10599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:42.928040 10599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:42.928370 10599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:42.928503 10599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:42.928743 10599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:42.929113 10599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:42.929152 10599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:42.929183 10599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:42.929207 10599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:42.934948 10599 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:40637
I20260811 01:04:42.935005 10797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:40637 every 8 connection(s)
I20260811 01:04:42.935333 10599 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:04:42.940387 10150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.936051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:33057 (local address 127.13.30.190:42281)
0811 01:04:42.936114 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.936116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.936350 (+ 234us) server_negotiation.cc:407] Connection header received
0811 01:04:42.936828 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.936829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.936839 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.936890 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:42.937578 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.938086 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.939092 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.939317 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.939382 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.940177 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:42.940178 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:42.940178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:42.940182 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:42.940192 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:42.940195 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:42.940228 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.940292 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.940324 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 01:04:42.940585 10803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.936045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42281 (local address 127.13.30.131:33057)
0811 01:04:42.936235 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:42.936272 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:42.936754 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:42.936946 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:42.936949 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:42.936956 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:42.937506 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.937513 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.938178 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.938179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.938985 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.938988 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.939399 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.939400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.939518 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.940053 (+ 535us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:04:42.940054 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:42.940085 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:04:42.940111 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:42.940237 (+ 126us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:42.940239 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:42.940242 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:04:42.940287 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 01:04:42.940378 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":91,"threads_started":1}
I20260811 01:04:42.941083 10798 heartbeater.cc:347] Connected to a master server at 127.13.30.190:42281
I20260811 01:04:42.941183 10798 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:42.941380 10798 heartbeater.cc:511] Master 127.13.30.190:42281 requested a full tablet report, sending...
I20260811 01:04:42.941776 10095 ts_manager.cc:194] Registered new tserver with Master: e561a169023f46ef8db704122960a496 (127.13.30.131:40637)
I20260811 01:04:42.942142 10095 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.30.131:33057
I20260811 01:04:42.942166 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 10599
I20260811 01:04:42.942252 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:04:42.942485 13434 external_mini_cluster.cc:1428] Setting key 3f37cafcdf5e9efb153af7c73c7f01dd
I20260811 01:04:42.943300 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:04:42.947141 10150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.944630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40298 (local address 127.13.30.190:42281)
0811 01:04:42.944672 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.944674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.944792 (+ 118us) server_negotiation.cc:407] Connection header received
0811 01:04:42.944844 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.944845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.944856 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.944900 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:42.945017 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.945534 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.946212 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.946387 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.946430 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.946949 (+ 519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:42.946950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:42.946951 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:42.946955 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:42.946969 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:42.946973 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:42.947008 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.947041 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.947064 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 01:04:42.948601 10095 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40298:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:04:42.950174 10095 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:04:42.957652 10813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.952280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:41645 (local address 127.0.0.1:42796)
0811 01:04:42.952443 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:42.952485 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:42.952549 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:42.954052 (+ 1503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:42.954053 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:42.954055 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:42.954097 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.954098 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.955040 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.955041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.956251 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.956255 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.957244 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.957245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.957336 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.957343 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 01:04:42.957375 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 01:04:42.957471 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":125,"thread_start_us":89,"threads_started":1}
I20260811 01:04:42.957652 10814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.952539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:37377 (local address 127.0.0.1:54664)
0811 01:04:42.953426 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:42.953470 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:42.953529 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:42.953741 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:42.953742 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:42.953744 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:42.953844 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.953847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.955208 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.955209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.956397 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.956401 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.957338 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.957338 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.957398 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.957404 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 01:04:42.957472 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 01:04:42.957524 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":865,"mutex_wait_us":5,"thread_start_us":130,"threads_started":1}
I20260811 01:04:42.957971 10819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.952913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38750 (local address 127.13.30.131:40637)
0811 01:04:42.953093 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.953098 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.953111 (+ 13us) server_negotiation.cc:407] Connection header received
0811 01:04:42.953153 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.953156 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.953172 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.953256 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:42.953505 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.954641 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.956516 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.957068 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.957137 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.957245 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.957840 (+ 595us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.957893 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":83,"threads_started":1}
I20260811 01:04:42.958138 10815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.952464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:40637 (local address 127.0.0.1:38750)
0811 01:04:42.952746 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:42.952762 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:42.952840 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:42.953274 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:42.953278 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:42.953280 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:42.953376 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.953378 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.954753 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.954755 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.956397 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:42.956401 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.957162 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.957164 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:42.957260 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.957277 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 01:04:42.957357 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 01:04:42.957465 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"mutex_wait_us":61,"thread_start_us":175,"threads_started":1}
I20260811 01:04:42.958171 10820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.952921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42796 (local address 127.13.30.129:41645)
0811 01:04:42.953887 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.953892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.953903 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:04:42.953950 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.953952 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.953968 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.954046 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:42.954151 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.954947 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.956355 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.957128 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.957628 (+ 500us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.957730 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.957956 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.958076 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":921,"thread_start_us":142,"threads_started":1}
I20260811 01:04:42.958901 10821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:42.953185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54664 (local address 127.13.30.130:37377)
0811 01:04:42.953568 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:42.953575 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:42.953587 (+ 12us) server_negotiation.cc:407] Connection header received
0811 01:04:42.953637 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:42.953639 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:42.953655 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:42.953735 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:42.953967 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.955094 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.956507 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:42.957260 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:42.957336 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:42.957480 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:42.957511 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 01:04:42.957557 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":106,"threads_started":1}
I20260811 01:04:42.959257 10284 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6fd49d0c39428b8add3188cc6cb62b (DEFAULT_TABLE table=test-table [id=9a79b0e3abc9429391a6bff7a2f61eff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:42.959344 10699 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6fd49d0c39428b8add3188cc6cb62b (DEFAULT_TABLE table=test-table [id=9a79b0e3abc9429391a6bff7a2f61eff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:42.959760 10699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6fd49d0c39428b8add3188cc6cb62b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:42.959761 10284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6fd49d0c39428b8add3188cc6cb62b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:42.959731 10484 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6fd49d0c39428b8add3188cc6cb62b (DEFAULT_TABLE table=test-table [id=9a79b0e3abc9429391a6bff7a2f61eff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:42.960103 10484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6fd49d0c39428b8add3188cc6cb62b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:42.962967 10822 tablet_bootstrap.cc:492] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496: Bootstrap starting.
I20260811 01:04:42.963374 10824 tablet_bootstrap.cc:492] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c: Bootstrap starting.
I20260811 01:04:42.963721 10823 tablet_bootstrap.cc:492] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9: Bootstrap starting.
I20260811 01:04:42.964129 10822 tablet_bootstrap.cc:654] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:42.964128 10824 tablet_bootstrap.cc:654] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:42.964497 10824 log.cc:824] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:42.964497 10822 log.cc:824] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:42.964886 10823 tablet_bootstrap.cc:654] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:42.965211 10823 log.cc:824] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:42.965289 10822 tablet_bootstrap.cc:492] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496: No bootstrap required, opened a new log
I20260811 01:04:42.965288 10824 tablet_bootstrap.cc:492] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c: No bootstrap required, opened a new log
I20260811 01:04:42.965364 10822 ts_tablet_manager.cc:1397] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:04:42.965364 10824 ts_tablet_manager.cc:1397] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:04:42.965951 10823 tablet_bootstrap.cc:492] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9: No bootstrap required, opened a new log
I20260811 01:04:42.966030 10823 ts_tablet_manager.cc:1397] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:04:42.968042 10823 raft_consensus.cc:348] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e561a169023f46ef8db704122960a496" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40637 } } peers { permanent_uuid: "e3efe84cddad49c7b25e5019c09069d9" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 41645 } } peers { permanent_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37377 } }
I20260811 01:04:42.968006 10822 raft_consensus.cc:348] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e561a169023f46ef8db704122960a496" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40637 } } peers { permanent_uuid: "e3efe84cddad49c7b25e5019c09069d9" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 41645 } } peers { permanent_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37377 } }
I20260811 01:04:42.968070 10824 raft_consensus.cc:348] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e561a169023f46ef8db704122960a496" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40637 } } peers { permanent_uuid: "e3efe84cddad49c7b25e5019c09069d9" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 41645 } } peers { permanent_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37377 } }
I20260811 01:04:42.968189 10823 raft_consensus.cc:374] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:42.968194 10824 raft_consensus.cc:374] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:42.968192 10822 raft_consensus.cc:374] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:42.968222 10823 raft_consensus.cc:729] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3efe84cddad49c7b25e5019c09069d9, State: Initialized, Role: FOLLOWER
I20260811 01:04:42.968228 10822 raft_consensus.cc:729] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e561a169023f46ef8db704122960a496, State: Initialized, Role: FOLLOWER
I20260811 01:04:42.968228 10824 raft_consensus.cc:729] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3806eec6cd924b3984ef7dc5ba89b81c, State: Initialized, Role: FOLLOWER
I20260811 01:04:42.968348 10823 consensus_queue.cc:260] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e561a169023f46ef8db704122960a496" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40637 } } peers { permanent_uuid: "e3efe84cddad49c7b25e5019c09069d9" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 41645 } } peers { permanent_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37377 } }
I20260811 01:04:42.968374 10822 consensus_queue.cc:260] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e561a169023f46ef8db704122960a496" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40637 } } peers { permanent_uuid: "e3efe84cddad49c7b25e5019c09069d9" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 41645 } } peers { permanent_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37377 } }
I20260811 01:04:42.968374 10824 consensus_queue.cc:260] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e561a169023f46ef8db704122960a496" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40637 } } peers { permanent_uuid: "e3efe84cddad49c7b25e5019c09069d9" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 41645 } } peers { permanent_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37377 } }
I20260811 01:04:42.968628 10823 ts_tablet_manager.cc:1428] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:04:42.968650 10824 ts_tablet_manager.cc:1428] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 01:04:42.968650 10822 ts_tablet_manager.cc:1428] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:04:42.968761 10380 heartbeater.cc:503] Master 127.13.30.190:42281 was elected leader, sending a full tablet report...
I20260811 01:04:42.968791 10798 heartbeater.cc:503] Master 127.13.30.190:42281 was elected leader, sending a full tablet report...
I20260811 01:04:42.968971 10593 heartbeater.cc:503] Master 127.13.30.190:42281 was elected leader, sending a full tablet report...
W20260811 01:04:43.051095 10594 tablet.cc:2369] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:04:43.110217 10831 raft_consensus.cc:482] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:04:43.110368 10831 raft_consensus.cc:504] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e561a169023f46ef8db704122960a496" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40637 } } peers { permanent_uuid: "e3efe84cddad49c7b25e5019c09069d9" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 41645 } } peers { permanent_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37377 } }
I20260811 01:04:43.110859 10831 leader_election.cc:288] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e561a169023f46ef8db704122960a496 (127.13.30.131:40637), e3efe84cddad49c7b25e5019c09069d9 (127.13.30.129:41645)
I20260811 01:04:43.114070 10597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:43.111066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:40637 (local address 127.13.30.130:45569)
0811 01:04:43.111114 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:43.111126 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:43.111166 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:43.111349 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:43.111350 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:43.111352 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:43.111438 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:43.111441 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:43.112160 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:43.112161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:43.113048 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:43.113051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:43.113758 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:43.113759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:43.113877 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:43.113895 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 01:04:43.113940 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 01:04:43.113973 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":17}
I20260811 01:04:43.114075 10836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:43.111066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:41645 (local address 127.13.30.130:38447)
0811 01:04:43.111361 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:43.111369 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:43.111433 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:43.111552 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:43.111553 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:43.111554 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:43.111626 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:43.111628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:43.112271 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:43.112272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:43.113068 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:43.113070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:43.113760 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:43.113760 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:43.113877 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:43.113882 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:04:43.113931 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 01:04:43.113969 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":137,"thread_start_us":96,"threads_started":1}
I20260811 01:04:43.114328 10820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:43.111165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:38447 (local address 127.13.30.129:41645)
0811 01:04:43.111226 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:43.111228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:43.111439 (+ 211us) server_negotiation.cc:407] Connection header received
0811 01:04:43.111474 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:43.111476 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:43.111490 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:43.111542 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:43.111715 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:43.112196 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:43.113149 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:43.113644 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:43.113712 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:43.113724 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:43.113955 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 01:04:43.114036 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 01:04:43.114403 10819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:43.111157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:45569 (local address 127.13.30.131:40637)
0811 01:04:43.111229 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:43.111231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:43.111240 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:04:43.111267 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:43.111268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:43.111275 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:43.111338 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:43.111526 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:43.112086 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:43.113125 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:43.113653 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:43.113757 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:43.113767 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:43.114283 (+ 516us) server_negotiation.cc:299] Negotiation successful
0811 01:04:43.114335 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 01:04:43.114675 10731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6fd49d0c39428b8add3188cc6cb62b" candidate_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e561a169023f46ef8db704122960a496" is_pre_election: true
I20260811 01:04:43.114661 10313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6fd49d0c39428b8add3188cc6cb62b" candidate_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3efe84cddad49c7b25e5019c09069d9" is_pre_election: true
I20260811 01:04:43.114832 10731 raft_consensus.cc:2454] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3806eec6cd924b3984ef7dc5ba89b81c in term 0.
I20260811 01:04:43.114832 10313 raft_consensus.cc:2454] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3806eec6cd924b3984ef7dc5ba89b81c in term 0.
I20260811 01:04:43.115063 10408 leader_election.cc:302] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3806eec6cd924b3984ef7dc5ba89b81c, e561a169023f46ef8db704122960a496; no voters:
I20260811 01:04:43.115201 10831 raft_consensus.cc:2781] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:04:43.115259 10831 raft_consensus.cc:482] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:04:43.115298 10831 raft_consensus.cc:3037] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:43.116034 10831 raft_consensus.cc:504] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e561a169023f46ef8db704122960a496" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40637 } } peers { permanent_uuid: "e3efe84cddad49c7b25e5019c09069d9" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 41645 } } peers { permanent_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37377 } }
I20260811 01:04:43.116173 10831 leader_election.cc:288] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [CANDIDATE]: Term 1 election: Requested vote from peers e561a169023f46ef8db704122960a496 (127.13.30.131:40637), e3efe84cddad49c7b25e5019c09069d9 (127.13.30.129:41645)
I20260811 01:04:43.116328 10731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6fd49d0c39428b8add3188cc6cb62b" candidate_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e561a169023f46ef8db704122960a496"
I20260811 01:04:43.116325 10313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6fd49d0c39428b8add3188cc6cb62b" candidate_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3efe84cddad49c7b25e5019c09069d9"
I20260811 01:04:43.116410 10731 raft_consensus.cc:3037] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:43.116410 10313 raft_consensus.cc:3037] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:43.117297 10313 raft_consensus.cc:2454] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3806eec6cd924b3984ef7dc5ba89b81c in term 1.
I20260811 01:04:43.117287 10731 raft_consensus.cc:2454] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3806eec6cd924b3984ef7dc5ba89b81c in term 1.
I20260811 01:04:43.117484 10407 leader_election.cc:302] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3806eec6cd924b3984ef7dc5ba89b81c, e3efe84cddad49c7b25e5019c09069d9; no voters:
I20260811 01:04:43.117581 10831 raft_consensus.cc:2781] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:43.117713 10831 raft_consensus.cc:686] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [term 1 LEADER]: Becoming Leader. State: Replica: 3806eec6cd924b3984ef7dc5ba89b81c, State: Running, Role: LEADER
I20260811 01:04:43.117802 10831 consensus_queue.cc:237] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e561a169023f46ef8db704122960a496" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40637 } } peers { permanent_uuid: "e3efe84cddad49c7b25e5019c09069d9" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 41645 } } peers { permanent_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37377 } }
I20260811 01:04:43.118616 10090 catalog_manager.cc:5495] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3806eec6cd924b3984ef7dc5ba89b81c (127.13.30.130). New cstate: current_term: 1 leader_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e561a169023f46ef8db704122960a496" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3efe84cddad49c7b25e5019c09069d9" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 41645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3806eec6cd924b3984ef7dc5ba89b81c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37377 } health_report { overall_health: HEALTHY } } }
I20260811 01:04:43.141252 10821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:43.139115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54670 (local address 127.13.30.130:37377)
0811 01:04:43.139173 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:43.139175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:43.139183 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:04:43.139225 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:43.139225 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:43.139244 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:43.139315 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:04:43.139417 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:43.139885 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:43.140584 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:43.140771 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:43.140819 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:43.140968 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:04:43.141074 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:04:43.141133 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:43.141145 (+ 12us) server_negotiation.cc:299] Negotiation successful
0811 01:04:43.141163 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 01:04:43.143249 10731 raft_consensus.cc:1261] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496 [term 1 FOLLOWER]: Refusing update from remote peer 3806eec6cd924b3984ef7dc5ba89b81c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:04:43.143249 10313 raft_consensus.cc:1261] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9 [term 1 FOLLOWER]: Refusing update from remote peer 3806eec6cd924b3984ef7dc5ba89b81c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:04:43.143615 10831 consensus_queue.cc:1035] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e561a169023f46ef8db704122960a496" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:04:43.143795 10837 consensus_queue.cc:1035] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3efe84cddad49c7b25e5019c09069d9" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 41645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:04:43.146093 10840 mvcc.cc:205] Tried to move back new op lower bound from 7317136519751880704 to 7317136519651086336. Current Snapshot: MvccSnapshot[applied={T|T < 7317136519751880704}]
I20260811 01:04:43.146425 10842 mvcc.cc:205] Tried to move back new op lower bound from 7317136519751880704 to 7317136519651086336. Current Snapshot: MvccSnapshot[applied={T|T < 7317136519751880704}]
I20260811 01:04:43.148747 10090 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:04:43.148872 10090 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:04:43.149664 10090 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c7244fa5ea94ccf8fc1ac92d2342742: Sending DeleteTablet for 3 replicas of tablet 1b6fd49d0c39428b8add3188cc6cb62b
I20260811 01:04:43.150060 10484 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b6fd49d0c39428b8add3188cc6cb62b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:43 UTC) from {username='slave'} at 127.0.0.1:54664
I20260811 01:04:43.150295 10852 tablet_replica.cc:330] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c: stopping tablet replica
I20260811 01:04:43.150406 10852 raft_consensus.cc:2229] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:04:43.150513 10852 raft_consensus.cc:2258] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:43.151046 10852 ts_tablet_manager.cc:1905] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:43.152901 10852 ts_tablet_manager.cc:1918] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:43.152985 10852 log.cc:1196] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/1b6fd49d0c39428b8add3188cc6cb62b
I20260811 01:04:43.153329 10852 ts_tablet_manager.cc:1939] T 1b6fd49d0c39428b8add3188cc6cb62b P 3806eec6cd924b3984ef7dc5ba89b81c: Deleting consensus metadata
I20260811 01:04:43.153834 10066 catalog_manager.cc:4841] TS 3806eec6cd924b3984ef7dc5ba89b81c (127.13.30.130:37377): tablet 1b6fd49d0c39428b8add3188cc6cb62b (table test-table [id=9a79b0e3abc9429391a6bff7a2f61eff]) successfully deleted
I20260811 01:04:43.153770 10284 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b6fd49d0c39428b8add3188cc6cb62b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:43 UTC) from {username='slave'} at 127.0.0.1:42796
I20260811 01:04:43.153721 10699 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b6fd49d0c39428b8add3188cc6cb62b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:43 UTC) from {username='slave'} at 127.0.0.1:38750
I20260811 01:04:43.154369 10854 tablet_replica.cc:330] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9: stopping tablet replica
I20260811 01:04:43.154588 10854 raft_consensus.cc:2229] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:43.154794 10854 raft_consensus.cc:2258] T 1b6fd49d0c39428b8add3188cc6cb62b P e3efe84cddad49c7b25e5019c09069d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:43.154917 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 10180
I20260811 01:04:43.155478 10853 tablet_replica.cc:330] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496: stopping tablet replica
I20260811 01:04:43.155597 10853 raft_consensus.cc:2229] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:43.155695 10853 raft_consensus.cc:2258] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:43.158675 10853 ts_tablet_manager.cc:1905] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:43.160661 10853 ts_tablet_manager.cc:1918] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:43.160756 10853 log.cc:1196] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/1b6fd49d0c39428b8add3188cc6cb62b
I20260811 01:04:43.161060 10853 ts_tablet_manager.cc:1939] T 1b6fd49d0c39428b8add3188cc6cb62b P e561a169023f46ef8db704122960a496: Deleting consensus metadata
I20260811 01:04:43.161659 10067 catalog_manager.cc:4841] TS e561a169023f46ef8db704122960a496 (127.13.30.131:40637): tablet 1b6fd49d0c39428b8add3188cc6cb62b (table test-table [id=9a79b0e3abc9429391a6bff7a2f61eff]) successfully deleted
W20260811 01:04:43.172449 10066 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:41645 (error 108)
I20260811 01:04:43.172631 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 10385
I20260811 01:04:43.177594 10815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:43.177356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:41645 (local address 127.0.0.1:42802)
0811 01:04:43.177468 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:43.177540 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:41645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 01:04:43.189754 10066 catalog_manager.cc:4584] TS e3efe84cddad49c7b25e5019c09069d9 (127.13.30.129:41645): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1b6fd49d0c39428b8add3188cc6cb62b: Network error: Client connection negotiation failed: client connection to 127.13.30.129:41645: connect: Connection refused (error 111)
I20260811 01:04:43.194664 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 10599
I20260811 01:04:43.226706 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 10036
2026-08-11T01:04:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (897 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:04:43 dist-test-slave-42z9 krb5kdc[10865](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:04:43 dist-test-slave-42z9 krb5kdc[10865](info): set up 2 sockets
Aug 11 01:04:43 dist-test-slave-42z9 krb5kdc[10865](info): commencing operation
krb5kdc: starting...
W20260811 01:04:44.424121 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:04:44 dist-test-slave-42z9 krb5kdc[10865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:04:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:04:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:04:44.560143 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:39287
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:42037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:39287
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:44.647562 10879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:44.647825 10879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:44.647859 10879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:44.649149 10879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:04:44.649209 10879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:44.649228 10879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:44.649245 10879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:04:44.649260 10879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:04:44.651000 10879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:42037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:39287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:39287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:44.651322 10879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:44.651567 10879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:44.656960 10893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:44.656971 10887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:44.656984 10888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:44.657573 10879 server_base.cc:1034] running on GCE node
I20260811 01:04:44.657817 10879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:44.658123 10879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:44.659375 10879 hybrid_clock.cc:648] HybridClock initialized: now 1786410284659341 us; error 34 us; skew 500 ppm
Aug 11 01:04:44 dist-test-slave-42z9 krb5kdc[10865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410284, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:44.670185 10879 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:04:44.670763 10879 webserver.cc:460] Webserver started at http://127.13.30.190:37081/ using document root <none> and password file <none>
I20260811 01:04:44.670997 10879 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:44.671047 10879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:44.671190 10879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:44.672375 10879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "b4650d9da21d45bdbf51b7524612da49"
format_stamp: "Formatted at 2026-08-11 01:04:44 on dist-test-slave-42z9"
server_key: "0585948bac740ff3a1085b48e31ad075"
server_key_iv: "787f89af984752bfb683c6bfb56056c0"
server_key_version: "encryptionkey@0"
I20260811 01:04:44.672765 10879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "b4650d9da21d45bdbf51b7524612da49"
format_stamp: "Formatted at 2026-08-11 01:04:44 on dist-test-slave-42z9"
server_key: "0585948bac740ff3a1085b48e31ad075"
server_key_iv: "787f89af984752bfb683c6bfb56056c0"
server_key_version: "encryptionkey@0"
I20260811 01:04:44.674464 10879 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:04:44.675719 10905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:44.675966 10879 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:44.676091 10879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "b4650d9da21d45bdbf51b7524612da49"
format_stamp: "Formatted at 2026-08-11 01:04:44 on dist-test-slave-42z9"
server_key: "0585948bac740ff3a1085b48e31ad075"
server_key_iv: "787f89af984752bfb683c6bfb56056c0"
server_key_version: "encryptionkey@0"
I20260811 01:04:44.676267 10879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:44.699817 10879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:44.702353 10879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:44.702488 10879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:44.706975 10879 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:39287
I20260811 01:04:44.707016 10989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:39287 every 8 connection(s)
I20260811 01:04:44.707406 10879 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:04:44.708029 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 10879
I20260811 01:04:44.708134 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:04:44.708338 13434 external_mini_cluster.cc:1428] Setting key 2fafbea1865e25d98b227162c930fa5f
I20260811 01:04:44.708461 10991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:44.712080 10991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49: Bootstrap starting.
I20260811 01:04:44.712759 10991 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:44.713048 10991 log.cc:824] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:44.713876 10991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49: No bootstrap required, opened a new log
Aug 11 01:04:44 dist-test-slave-42z9 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:04:44.715849 10991 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4650d9da21d45bdbf51b7524612da49" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 39287 } }
I20260811 01:04:44.716004 10991 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:44.716040 10991 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4650d9da21d45bdbf51b7524612da49, State: Initialized, Role: FOLLOWER
I20260811 01:04:44.716212 10991 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4650d9da21d45bdbf51b7524612da49" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 39287 } }
I20260811 01:04:44.716312 10991 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:04:44.716348 10991 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:04:44.716403 10991 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:44.717139 10991 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4650d9da21d45bdbf51b7524612da49" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 39287 } }
I20260811 01:04:44.717238 10991 leader_election.cc:302] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4650d9da21d45bdbf51b7524612da49; no voters:
I20260811 01:04:44.717413 10991 leader_election.cc:288] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:04:44.717485 10999 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:44.717646 10999 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [term 1 LEADER]: Becoming Leader. State: Replica: b4650d9da21d45bdbf51b7524612da49, State: Running, Role: LEADER
I20260811 01:04:44.717738 10999 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4650d9da21d45bdbf51b7524612da49" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 39287 } }
I20260811 01:04:44.717777 10991 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:04:44.718106 10999 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4650d9da21d45bdbf51b7524612da49. Latest consensus state: current_term: 1 leader_uuid: "b4650d9da21d45bdbf51b7524612da49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4650d9da21d45bdbf51b7524612da49" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 39287 } } }
I20260811 01:04:44.718186 10999 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:44.718348 11000 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4650d9da21d45bdbf51b7524612da49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4650d9da21d45bdbf51b7524612da49" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 39287 } } }
I20260811 01:04:44.718421 11000 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49 [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:44.719782 10996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:44.708862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40766 (local address 127.13.30.190:39287)
0811 01:04:44.709080 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:44.709091 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:44.709127 (+ 36us) server_negotiation.cc:407] Connection header received
0811 01:04:44.709671 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:44.709681 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:44.709748 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:44.709914 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:44.710528 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:44.711923 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:44.712978 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:44.713460 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:44.713564 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:44.715901 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:44.715905 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:44.715905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:44.715917 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:44.717685 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:44.718155 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:44.718158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:44.718158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:44.718268 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:44.718661 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:44.718662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:44.718662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:44.718978 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:44.719376 (+ 398us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:44.719450 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 01:04:44.719619 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":110,"threads_started":1}
W20260811 01:04:44.720305 11022 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:04:44.720357 11022 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:04:44.720408 11009 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:04:44.720568 11009 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:04:44.722509 11009 catalog_manager.cc:1347] Generated new cluster ID: 090bbe50fd6e4720824c34e7c897f2dc
I20260811 01:04:44.722560 11009 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:04:44.731750 11009 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:04:44.732286 11009 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:04:44.742324 11009 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49: Generated new TSK 0
I20260811 01:04:44.742583 11009 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:04:44.776321 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:39287
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:42037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:44.885331 11031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:44.885614 11031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:44.885643 11031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:44.886880 11031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:44.886927 11031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:44.886956 11031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:04:44.888510 11031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:42037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:39287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:44.888760 11031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:44.889002 11031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:44.894253 11043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:44.894268 11041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:44.894304 11040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:44.894472 11031 server_base.cc:1034] running on GCE node
I20260811 01:04:44.894698 11031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:44.894956 11031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:44.896121 11031 hybrid_clock.cc:648] HybridClock initialized: now 1786410284896105 us; error 31 us; skew 500 ppm
Aug 11 01:04:44 dist-test-slave-42z9 krb5kdc[10865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410284, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:44.898875 11031 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:04:44.899408 11031 webserver.cc:460] Webserver started at http://127.13.30.129:40661/ using document root <none> and password file <none>
I20260811 01:04:44.899626 11031 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:44.899678 11031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:44.899814 11031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:44.900934 11031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "b59336eccd7447f59a5ea7eb38734e54"
format_stamp: "Formatted at 2026-08-11 01:04:44 on dist-test-slave-42z9"
server_key: "f35d225ef26a29aac15822236e1a4b77"
server_key_iv: "d305f74285e591ba53df4155fb955359"
server_key_version: "encryptionkey@0"
I20260811 01:04:44.901291 11031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "b59336eccd7447f59a5ea7eb38734e54"
format_stamp: "Formatted at 2026-08-11 01:04:44 on dist-test-slave-42z9"
server_key: "f35d225ef26a29aac15822236e1a4b77"
server_key_iv: "d305f74285e591ba53df4155fb955359"
server_key_version: "encryptionkey@0"
I20260811 01:04:44.902717 11031 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:44.903462 11052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:44.903641 11031 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 01:04:44.903728 11031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "b59336eccd7447f59a5ea7eb38734e54"
format_stamp: "Formatted at 2026-08-11 01:04:44 on dist-test-slave-42z9"
server_key: "f35d225ef26a29aac15822236e1a4b77"
server_key_iv: "d305f74285e591ba53df4155fb955359"
server_key_version: "encryptionkey@0"
I20260811 01:04:44.903801 11031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:44.930701 11031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:44.933832 11031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:44.934043 11031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:44.934355 11031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:44.934775 11031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:44.934815 11031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:44.934854 11031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:44.934877 11031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:44.942622 11031 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:35697
I20260811 01:04:44.942751 11234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:35697 every 8 connection(s)
I20260811 01:04:44.943109 11031 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:04:44.944218 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 11031
I20260811 01:04:44.944351 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:04:44.944607 13434 external_mini_cluster.cc:1428] Setting key d9770874d8400380eb7208094430615d
Aug 11 01:04:44 dist-test-slave-42z9 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410284, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
I20260811 01:04:44.954777 10996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:44.944409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:53487 (local address 127.13.30.190:39287)
0811 01:04:44.944467 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:44.944469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:44.944484 (+ 15us) server_negotiation.cc:407] Connection header received
0811 01:04:44.945124 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:44.945125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:44.945138 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:44.945180 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:44.946389 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:44.947144 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:44.948743 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:44.949096 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:44.949149 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:44.951869 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:44.951871 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:44.951872 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:44.951882 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:44.953240 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:44.953732 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:44.953733 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:44.953734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:44.953803 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:44.954079 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:44.954080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:44.954080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:44.954211 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:44.954266 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:44.954573 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 01:04:44.954677 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 01:04:44.954972 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:44.944019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:39287 (local address 127.13.30.129:53487)
0811 01:04:44.944318 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:44.944395 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:44.945012 (+ 617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:44.945273 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:44.945277 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:44.946001 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:44.946228 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:44.946233 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:44.947274 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:44.947275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:44.948620 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:44.948624 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:44.949271 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:44.949272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:44.949428 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:44.950053 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:04:44.950062 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:44.951739 (+ 1677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:44.953342 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:44.953351 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:44.953354 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:44.953657 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:44.953862 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:44.953863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:44.953863 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:44.954009 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:44.954269 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:44.954276 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:44.954433 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 01:04:44.954527 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 01:04:44.954718 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":144,"threads_started":1}
I20260811 01:04:44.955504 11236 heartbeater.cc:347] Connected to a master server at 127.13.30.190:39287
I20260811 01:04:44.955603 11236 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:44.955811 11236 heartbeater.cc:511] Master 127.13.30.190:39287 requested a full tablet report, sending...
I20260811 01:04:44.956410 10936 ts_manager.cc:194] Registered new tserver with Master: b59336eccd7447f59a5ea7eb38734e54 (127.13.30.129:35697)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
I20260811 01:04:44.957180 10936 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:53487
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:04:44.973527 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:39287
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:42037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:45.066596 11245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:45.066811 11245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:45.066836 11245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:45.067976 11245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:45.068010 11245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:45.068035 11245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:04:45.069519 11245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:42037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:39287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:45.069725 11245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:45.069921 11245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:45.075130 11254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:45.075148 11256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:45.075125 11258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:45.075229 11245 server_base.cc:1034] running on GCE node
I20260811 01:04:45.075546 11245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:45.075788 11245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:45.076956 11245 hybrid_clock.cc:648] HybridClock initialized: now 1786410285076941 us; error 30 us; skew 500 ppm
Aug 11 01:04:45 dist-test-slave-42z9 krb5kdc[10865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410285, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:45.079797 11245 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:04:45.080256 11245 webserver.cc:460] Webserver started at http://127.13.30.130:40711/ using document root <none> and password file <none>
I20260811 01:04:45.080451 11245 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:45.080502 11245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:45.080600 11245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:45.081776 11245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "e6eb7529fd38445db08b57b203dbe071"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "7018271cf8195ddb3082183134b4a799"
server_key_iv: "e8c357d05f1c1753122132ba440c2dd6"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.082089 11245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "e6eb7529fd38445db08b57b203dbe071"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "7018271cf8195ddb3082183134b4a799"
server_key_iv: "e8c357d05f1c1753122132ba440c2dd6"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.083366 11245 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:45.084048 11269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:45.084209 11245 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:04:45.084295 11245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "e6eb7529fd38445db08b57b203dbe071"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "7018271cf8195ddb3082183134b4a799"
server_key_iv: "e8c357d05f1c1753122132ba440c2dd6"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.084359 11245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:45.099188 11245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:45.101926 11245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:45.102061 11245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:45.102284 11245 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:45.102583 11245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:45.102614 11245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:45.102641 11245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:45.102658 11245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:45.108825 11245 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:39303
I20260811 01:04:45.108877 11449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:39303 every 8 connection(s)
I20260811 01:04:45.109215 11245 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:04:45.111335 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 11245
I20260811 01:04:45.111439 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:04:45.111611 13434 external_mini_cluster.cc:1428] Setting key 5a320d36d23377f11aa8321b1e9e8db3
Aug 11 01:04:45 dist-test-slave-42z9 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410285, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:04:45.118780 10996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.109974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:42543 (local address 127.13.30.190:39287)
0811 01:04:45.110021 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:45.110023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:45.110253 (+ 230us) server_negotiation.cc:407] Connection header received
0811 01:04:45.110784 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:45.110786 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:45.110800 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:45.110852 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:45.111894 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.112405 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.113411 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.113669 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.113728 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.115873 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:45.115875 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:45.115875 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:45.115884 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:45.117254 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:45.117753 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:45.117755 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:45.117755 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:45.117815 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:45.118065 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:45.118066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:45.118066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:45.118194 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:45.118252 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:45.118542 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 01:04:45.118654 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 01:04:45.118999 11452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.109936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:39287 (local address 127.13.30.130:42543)
0811 01:04:45.110128 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:45.110166 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:45.110685 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:45.110924 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:45.110928 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:45.111565 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:45.111804 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.111809 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.112506 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.112507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.113320 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.113323 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.113748 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.113749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.113877 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.114393 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:04:45.114402 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:45.115775 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:45.117337 (+ 1562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:45.117346 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:45.117349 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:45.117685 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:45.117886 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:45.117887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:45.117888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:45.118008 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:45.118249 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:45.118256 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:45.118406 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 01:04:45.118511 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 01:04:45.118751 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":102,"threads_started":1}
I20260811 01:04:45.119505 11450 heartbeater.cc:347] Connected to a master server at 127.13.30.190:39287
I20260811 01:04:45.119607 11450 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:45.119804 11450 heartbeater.cc:511] Master 127.13.30.190:39287 requested a full tablet report, sending...
I20260811 01:04:45.120249 10936 ts_manager.cc:194] Registered new tserver with Master: e6eb7529fd38445db08b57b203dbe071 (127.13.30.130:39303)
I20260811 01:04:45.120784 10936 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:42543
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:04:45.141225 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:39287
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:42037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:45.231179 11458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:45.231420 11458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:45.231447 11458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:45.232647 11458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:45.232693 11458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:45.232723 11458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:04:45.234325 11458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:42037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:39287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:45.234565 11458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:45.234776 11458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:45.240622 11464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:45.240641 11466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:45.240797 11458 server_base.cc:1034] running on GCE node
W20260811 01:04:45.240680 11470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:45.241053 11458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:45.241293 11458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:45.242504 11458 hybrid_clock.cc:648] HybridClock initialized: now 1786410285242483 us; error 33 us; skew 500 ppm
Aug 11 01:04:45 dist-test-slave-42z9 krb5kdc[10865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410285, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:45.245245 11458 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:04:45.245759 11458 webserver.cc:460] Webserver started at http://127.13.30.131:45395/ using document root <none> and password file <none>
I20260811 01:04:45.245980 11458 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:45.246033 11458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:45.246169 11458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:45.247256 11458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "95f5cc756f0c47748444b89b8601f71a"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "3b942793c86d03780f6790cbcbaabc08"
server_key_iv: "6bc18fcac83990afbfaf4cba5540f13e"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.247632 11458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "95f5cc756f0c47748444b89b8601f71a"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "3b942793c86d03780f6790cbcbaabc08"
server_key_iv: "6bc18fcac83990afbfaf4cba5540f13e"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.249157 11458 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:04:45.250264 11479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:45.250531 11458 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:45.250654 11458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "95f5cc756f0c47748444b89b8601f71a"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "3b942793c86d03780f6790cbcbaabc08"
server_key_iv: "6bc18fcac83990afbfaf4cba5540f13e"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.250751 11458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:45.268261 11458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:45.270561 11458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:45.270716 11458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:45.270977 11458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:45.271286 11458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:45.271337 11458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:45.271376 11458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:45.271401 11458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:45.277568 11458 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:42415
I20260811 01:04:45.277611 11676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:42415 every 8 connection(s)
I20260811 01:04:45.277961 11458 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:04:45.278095 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 11458
I20260811 01:04:45.278187 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:04:45.278373 13434 external_mini_cluster.cc:1428] Setting key 11be0db9e2472952254dbae1e1809622
Aug 11 01:04:45 dist-test-slave-42z9 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410285, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:04:45.288112 10996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.278780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:52277 (local address 127.13.30.190:39287)
0811 01:04:45.278835 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:45.278837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:45.279089 (+ 252us) server_negotiation.cc:407] Connection header received
0811 01:04:45.279689 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:45.279691 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:45.279704 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:45.279746 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:45.280794 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.281314 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.282347 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.282562 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.282629 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.285488 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:45.285491 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:45.285491 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:45.285501 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:45.286863 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:45.287325 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:45.287326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:45.287326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:45.287390 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:45.287594 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:45.287595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:45.287595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:45.287708 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:45.287754 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:45.287974 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 01:04:45.288042 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 01:04:45.288331 11682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.278790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:39287 (local address 127.13.30.131:52277)
0811 01:04:45.278959 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:45.279005 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:45.279596 (+ 591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:45.279835 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:45.279840 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:45.280490 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:45.280704 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.280709 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.281402 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.281403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.282260 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.282262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.282649 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.282651 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.282818 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.283445 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:04:45.283458 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:45.285350 (+ 1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:45.286952 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:45.286960 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:45.286962 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:45.287266 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:45.287451 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:45.287452 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:45.287452 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:45.287554 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:45.287751 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:45.287754 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:45.287884 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 01:04:45.287965 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 01:04:45.288099 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
I20260811 01:04:45.289150 11680 heartbeater.cc:347] Connected to a master server at 127.13.30.190:39287
I20260811 01:04:45.289259 11680 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:45.289433 11680 heartbeater.cc:511] Master 127.13.30.190:39287 requested a full tablet report, sending...
I20260811 01:04:45.289878 10936 ts_manager.cc:194] Registered new tserver with Master: 95f5cc756f0c47748444b89b8601f71a (127.13.30.131:42415)
I20260811 01:04:45.290279 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:04:45.290434 10936 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:52277
I20260811 01:04:45.299676 10996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.291997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40776 (local address 127.13.30.190:39287)
0811 01:04:45.292094 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:45.292096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:45.292126 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:04:45.292235 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:45.292237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:45.292250 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:45.292305 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:45.293209 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.293944 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.294809 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.295018 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.295074 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.296622 (+ 1548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:45.296624 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:45.296624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:45.296633 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:45.298216 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:45.298749 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:45.298750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:45.298751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:45.298818 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:45.299024 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:45.299024 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:45.299025 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:45.299200 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:45.299332 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:45.299483 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 01:04:45.299559 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 01:04:45.301806 10936 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40776:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:04:45.303524 10936 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:04:45.310514 11701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.306005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:35697 (local address 127.0.0.1:47274)
0811 01:04:45.306382 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:45.306414 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:45.306499 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:45.306725 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:45.306726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:45.306729 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:45.306972 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.306975 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.308291 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.308292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.309168 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.309171 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.310050 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.310051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.310191 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.310214 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 01:04:45.310315 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 01:04:45.310398 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"mutex_wait_us":151,"thread_start_us":92,"threads_started":1}
I20260811 01:04:45.310528 11698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.306135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47274 (local address 127.13.30.129:35697)
0811 01:04:45.306339 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:45.306343 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:45.306570 (+ 227us) server_negotiation.cc:407] Connection header received
0811 01:04:45.306609 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:45.306610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:45.306623 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:45.306809 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:45.307091 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.308199 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.309254 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.309942 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.310028 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.310107 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:45.310344 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 01:04:45.310390 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":104,"threads_started":1}
I20260811 01:04:45.310904 11697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.305955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:42415 (local address 127.0.0.1:39864)
0811 01:04:45.306359 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:45.306403 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:45.306490 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:45.306712 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:45.306715 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:45.306717 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:45.306856 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.306858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.308262 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.308263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.309600 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.309610 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.310603 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.310605 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.310698 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.310704 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 01:04:45.310757 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 01:04:45.310817 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":57,"thread_start_us":70,"threads_started":1}
I20260811 01:04:45.310913 11702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.306166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39864 (local address 127.13.30.131:42415)
0811 01:04:45.306507 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:45.306512 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:45.306523 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:04:45.306588 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:45.306590 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:45.306608 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:45.306919 (+ 311us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:45.307030 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.308153 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.309748 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.310420 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.310499 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.310556 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:45.310787 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 01:04:45.310835 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":85,"threads_started":1}
I20260811 01:04:45.311363 11695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.306178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:39303 (local address 127.0.0.1:49904)
0811 01:04:45.306596 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:45.306605 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:45.306651 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:45.306879 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:45.306880 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:45.306882 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:45.306930 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.306931 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.307928 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.307929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.309217 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.309221 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.310495 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.310496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.310557 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.310562 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:04:45.311246 (+ 684us) client_negotiation.cc:240] Negotiation successful
0811 01:04:45.311309 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":68,"threads_started":1}
I20260811 01:04:45.311652 11705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.306301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49904 (local address 127.13.30.130:39303)
0811 01:04:45.306486 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:45.306490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:45.306664 (+ 174us) server_negotiation.cc:407] Connection header received
0811 01:04:45.306711 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:45.306713 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:45.306727 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:45.306798 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:45.307023 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.307837 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.309316 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.310312 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.310383 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.310453 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:45.311499 (+ 1046us) server_negotiation.cc:299] Negotiation successful
0811 01:04:45.311567 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":88,"threads_started":1}
I20260811 01:04:45.311630 11130 tablet_service.cc:1467] Processing CreateTablet for tablet d99934e4cbe442acb04be51d5ff05f33 (DEFAULT_TABLE table=test-table [id=21827119e80f4b03acf5502e5b4439cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:45.312075 11130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d99934e4cbe442acb04be51d5ff05f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:45.312506 11338 tablet_service.cc:1467] Processing CreateTablet for tablet d99934e4cbe442acb04be51d5ff05f33 (DEFAULT_TABLE table=test-table [id=21827119e80f4b03acf5502e5b4439cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:45.312891 11338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d99934e4cbe442acb04be51d5ff05f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:45.314200 11558 tablet_service.cc:1467] Processing CreateTablet for tablet d99934e4cbe442acb04be51d5ff05f33 (DEFAULT_TABLE table=test-table [id=21827119e80f4b03acf5502e5b4439cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:45.314570 11558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d99934e4cbe442acb04be51d5ff05f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:45.315272 11706 tablet_bootstrap.cc:492] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54: Bootstrap starting.
I20260811 01:04:45.316165 11707 tablet_bootstrap.cc:492] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071: Bootstrap starting.
I20260811 01:04:45.316303 11706 tablet_bootstrap.cc:654] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:45.316670 11706 log.cc:824] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:45.317044 11707 tablet_bootstrap.cc:654] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:45.317480 11706 tablet_bootstrap.cc:492] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54: No bootstrap required, opened a new log
I20260811 01:04:45.317582 11706 ts_tablet_manager.cc:1397] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:04:45.317735 11707 log.cc:824] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:45.318145 11711 tablet_bootstrap.cc:492] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a: Bootstrap starting.
I20260811 01:04:45.318599 11707 tablet_bootstrap.cc:492] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071: No bootstrap required, opened a new log
I20260811 01:04:45.318674 11707 ts_tablet_manager.cc:1397] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 01:04:45.318887 11711 tablet_bootstrap.cc:654] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:45.319487 11711 log.cc:824] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:45.319594 11706 raft_consensus.cc:348] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f5cc756f0c47748444b89b8601f71a" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42415 } } peers { permanent_uuid: "e6eb7529fd38445db08b57b203dbe071" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39303 } } peers { permanent_uuid: "b59336eccd7447f59a5ea7eb38734e54" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35697 } }
I20260811 01:04:45.319794 11706 raft_consensus.cc:374] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:45.319847 11706 raft_consensus.cc:729] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b59336eccd7447f59a5ea7eb38734e54, State: Initialized, Role: FOLLOWER
I20260811 01:04:45.319984 11706 consensus_queue.cc:260] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f5cc756f0c47748444b89b8601f71a" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42415 } } peers { permanent_uuid: "e6eb7529fd38445db08b57b203dbe071" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39303 } } peers { permanent_uuid: "b59336eccd7447f59a5ea7eb38734e54" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35697 } }
I20260811 01:04:45.320279 11706 ts_tablet_manager.cc:1428] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 01:04:45.320369 11711 tablet_bootstrap.cc:492] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a: No bootstrap required, opened a new log
I20260811 01:04:45.320447 11711 ts_tablet_manager.cc:1397] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:04:45.320801 11707 raft_consensus.cc:348] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f5cc756f0c47748444b89b8601f71a" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42415 } } peers { permanent_uuid: "e6eb7529fd38445db08b57b203dbe071" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39303 } } peers { permanent_uuid: "b59336eccd7447f59a5ea7eb38734e54" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35697 } }
I20260811 01:04:45.320998 11707 raft_consensus.cc:374] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:45.321040 11707 raft_consensus.cc:729] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6eb7529fd38445db08b57b203dbe071, State: Initialized, Role: FOLLOWER
I20260811 01:04:45.321159 11707 consensus_queue.cc:260] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f5cc756f0c47748444b89b8601f71a" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42415 } } peers { permanent_uuid: "e6eb7529fd38445db08b57b203dbe071" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39303 } } peers { permanent_uuid: "b59336eccd7447f59a5ea7eb38734e54" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35697 } }
I20260811 01:04:45.321516 11707 ts_tablet_manager.cc:1428] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:04:45.321548 11450 heartbeater.cc:503] Master 127.13.30.190:39287 was elected leader, sending a full tablet report...
I20260811 01:04:45.321657 11236 heartbeater.cc:503] Master 127.13.30.190:39287 was elected leader, sending a full tablet report...
I20260811 01:04:45.322500 11711 raft_consensus.cc:348] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f5cc756f0c47748444b89b8601f71a" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42415 } } peers { permanent_uuid: "e6eb7529fd38445db08b57b203dbe071" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39303 } } peers { permanent_uuid: "b59336eccd7447f59a5ea7eb38734e54" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35697 } }
I20260811 01:04:45.322682 11711 raft_consensus.cc:374] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:45.322722 11711 raft_consensus.cc:729] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f5cc756f0c47748444b89b8601f71a, State: Initialized, Role: FOLLOWER
I20260811 01:04:45.322835 11711 consensus_queue.cc:260] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f5cc756f0c47748444b89b8601f71a" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42415 } } peers { permanent_uuid: "e6eb7529fd38445db08b57b203dbe071" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39303 } } peers { permanent_uuid: "b59336eccd7447f59a5ea7eb38734e54" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35697 } }
I20260811 01:04:45.323100 11711 ts_tablet_manager.cc:1428] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:04:45.323156 11680 heartbeater.cc:503] Master 127.13.30.190:39287 was elected leader, sending a full tablet report...
W20260811 01:04:45.359864 11451 tablet.cc:2369] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:04:45.373579 11715 raft_consensus.cc:482] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:04:45.373760 11715 raft_consensus.cc:504] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f5cc756f0c47748444b89b8601f71a" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42415 } } peers { permanent_uuid: "e6eb7529fd38445db08b57b203dbe071" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39303 } } peers { permanent_uuid: "b59336eccd7447f59a5ea7eb38734e54" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35697 } }
I20260811 01:04:45.374142 11715 leader_election.cc:288] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95f5cc756f0c47748444b89b8601f71a (127.13.30.131:42415), e6eb7529fd38445db08b57b203dbe071 (127.13.30.130:39303)
I20260811 01:04:45.377219 11702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.374486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:53553 (local address 127.13.30.131:42415)
0811 01:04:45.374547 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:45.374549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:45.374560 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:04:45.374665 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:45.374666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:45.374677 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:45.374757 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:45.374934 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.375458 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.376494 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.376878 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.376950 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.376960 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:45.377112 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 01:04:45.377154 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 01:04:45.377218 11705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.374709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:48381 (local address 127.13.30.130:39303)
0811 01:04:45.374762 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:45.374764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:45.374794 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:04:45.374856 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:45.374857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:45.374867 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:45.374913 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:45.375052 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.375534 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.376503 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.376888 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.376955 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.376966 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:45.377107 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 01:04:45.377144 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 01:04:45.377238 11718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.374532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:39303 (local address 127.13.30.129:48381)
0811 01:04:45.374732 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:45.374743 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:45.374803 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:45.374925 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:45.374926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:45.374928 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:45.374994 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.374995 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.375615 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.375616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.376395 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.376397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.376970 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.376971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.377038 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.377042 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:04:45.377087 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 01:04:45.377134 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":2,"thread_start_us":132,"threads_started":1}
I20260811 01:04:45.377243 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.374388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:42415 (local address 127.13.30.129:53553)
0811 01:04:45.374488 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:45.374500 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:45.374550 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:45.374777 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:45.374778 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:45.374780 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:45.374859 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.374861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.375546 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.375547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.376393 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.376395 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.376962 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.376963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.377046 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.377049 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:04:45.377099 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 01:04:45.377144 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"mutex_wait_us":45}
I20260811 01:04:45.377665 11373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d99934e4cbe442acb04be51d5ff05f33" candidate_uuid: "b59336eccd7447f59a5ea7eb38734e54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6eb7529fd38445db08b57b203dbe071" is_pre_election: true
I20260811 01:04:45.377671 11585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d99934e4cbe442acb04be51d5ff05f33" candidate_uuid: "b59336eccd7447f59a5ea7eb38734e54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5cc756f0c47748444b89b8601f71a" is_pre_election: true
I20260811 01:04:45.377821 11373 raft_consensus.cc:2454] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b59336eccd7447f59a5ea7eb38734e54 in term 0.
I20260811 01:04:45.377821 11585 raft_consensus.cc:2454] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b59336eccd7447f59a5ea7eb38734e54 in term 0.
I20260811 01:04:45.378064 11058 leader_election.cc:302] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95f5cc756f0c47748444b89b8601f71a, b59336eccd7447f59a5ea7eb38734e54; no voters:
I20260811 01:04:45.378196 11715 raft_consensus.cc:2781] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:04:45.378257 11715 raft_consensus.cc:482] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:04:45.378273 11715 raft_consensus.cc:3037] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:45.379089 11715 raft_consensus.cc:504] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f5cc756f0c47748444b89b8601f71a" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42415 } } peers { permanent_uuid: "e6eb7529fd38445db08b57b203dbe071" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39303 } } peers { permanent_uuid: "b59336eccd7447f59a5ea7eb38734e54" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35697 } }
I20260811 01:04:45.379230 11715 leader_election.cc:288] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [CANDIDATE]: Term 1 election: Requested vote from peers 95f5cc756f0c47748444b89b8601f71a (127.13.30.131:42415), e6eb7529fd38445db08b57b203dbe071 (127.13.30.130:39303)
I20260811 01:04:45.379485 11585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d99934e4cbe442acb04be51d5ff05f33" candidate_uuid: "b59336eccd7447f59a5ea7eb38734e54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5cc756f0c47748444b89b8601f71a"
I20260811 01:04:45.379500 11373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d99934e4cbe442acb04be51d5ff05f33" candidate_uuid: "b59336eccd7447f59a5ea7eb38734e54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6eb7529fd38445db08b57b203dbe071"
I20260811 01:04:45.379556 11585 raft_consensus.cc:3037] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:45.379590 11373 raft_consensus.cc:3037] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:45.380318 11585 raft_consensus.cc:2454] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59336eccd7447f59a5ea7eb38734e54 in term 1.
I20260811 01:04:45.380434 11373 raft_consensus.cc:2454] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59336eccd7447f59a5ea7eb38734e54 in term 1.
I20260811 01:04:45.380522 11058 leader_election.cc:302] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95f5cc756f0c47748444b89b8601f71a, b59336eccd7447f59a5ea7eb38734e54; no voters:
I20260811 01:04:45.380601 11715 raft_consensus.cc:2781] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:45.380762 11715 raft_consensus.cc:686] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [term 1 LEADER]: Becoming Leader. State: Replica: b59336eccd7447f59a5ea7eb38734e54, State: Running, Role: LEADER
I20260811 01:04:45.380862 11715 consensus_queue.cc:237] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f5cc756f0c47748444b89b8601f71a" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42415 } } peers { permanent_uuid: "e6eb7529fd38445db08b57b203dbe071" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39303 } } peers { permanent_uuid: "b59336eccd7447f59a5ea7eb38734e54" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35697 } }
I20260811 01:04:45.381760 10936 catalog_manager.cc:5495] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 reported cstate change: term changed from 0 to 1, leader changed from <none> to b59336eccd7447f59a5ea7eb38734e54 (127.13.30.129). New cstate: current_term: 1 leader_uuid: "b59336eccd7447f59a5ea7eb38734e54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f5cc756f0c47748444b89b8601f71a" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6eb7529fd38445db08b57b203dbe071" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59336eccd7447f59a5ea7eb38734e54" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 35697 } health_report { overall_health: HEALTHY } } }
I20260811 01:04:45.404668 11698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.402292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47282 (local address 127.13.30.129:35697)
0811 01:04:45.402378 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:45.402381 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:45.402391 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:04:45.402433 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:45.402434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:45.402454 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:45.402543 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:04:45.402697 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.403196 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.403996 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.404190 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.404237 (+ 47us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.404358 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:04:45.404451 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:04:45.404540 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:45.404571 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 01:04:45.404581 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 01:04:45.406699 11373 raft_consensus.cc:1261] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071 [term 1 FOLLOWER]: Refusing update from remote peer b59336eccd7447f59a5ea7eb38734e54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:04:45.406699 11585 raft_consensus.cc:1261] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a [term 1 FOLLOWER]: Refusing update from remote peer b59336eccd7447f59a5ea7eb38734e54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:04:45.407086 11715 consensus_queue.cc:1035] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5cc756f0c47748444b89b8601f71a" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 42415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:04:45.407250 11719 consensus_queue.cc:1035] T d99934e4cbe442acb04be51d5ff05f33 P b59336eccd7447f59a5ea7eb38734e54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6eb7529fd38445db08b57b203dbe071" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 39303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:04:45.410356 11724 mvcc.cc:205] Tried to move back new op lower bound from 7317136529022816256 to 7317136528920625152. Current Snapshot: MvccSnapshot[applied={T|T < 7317136529022816256 or (T in {7317136529022816256})}]
I20260811 01:04:45.412793 10936 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:04:45.412921 10936 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:04:45.414072 10936 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b4650d9da21d45bdbf51b7524612da49: Sending DeleteTablet for 3 replicas of tablet d99934e4cbe442acb04be51d5ff05f33
I20260811 01:04:45.414559 11558 tablet_service.cc:1514] Processing DeleteTablet for tablet d99934e4cbe442acb04be51d5ff05f33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:45 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:39864
I20260811 01:04:45.414698 11338 tablet_service.cc:1514] Processing DeleteTablet for tablet d99934e4cbe442acb04be51d5ff05f33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:45 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:49904
I20260811 01:04:45.414898 11130 tablet_service.cc:1514] Processing DeleteTablet for tablet d99934e4cbe442acb04be51d5ff05f33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:45 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:47274
I20260811 01:04:45.415125 11744 tablet_replica.cc:330] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071: stopping tablet replica
I20260811 01:04:45.415328 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 11031
I20260811 01:04:45.415331 11744 raft_consensus.cc:2229] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:45.415581 11744 raft_consensus.cc:2258] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:45.416599 11744 ts_tablet_manager.cc:1905] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:45.419480 11744 ts_tablet_manager.cc:1918] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:45.419690 11744 log.cc:1196] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/d99934e4cbe442acb04be51d5ff05f33
I20260811 01:04:45.420222 11744 ts_tablet_manager.cc:1939] T d99934e4cbe442acb04be51d5ff05f33 P e6eb7529fd38445db08b57b203dbe071: Deleting consensus metadata
I20260811 01:04:45.421005 10910 catalog_manager.cc:4841] TS e6eb7529fd38445db08b57b203dbe071 (127.13.30.130:39303): tablet d99934e4cbe442acb04be51d5ff05f33 (table test-table [id=21827119e80f4b03acf5502e5b4439cc]) successfully deleted
I20260811 01:04:45.431898 11743 tablet_replica.cc:330] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a: stopping tablet replica
I20260811 01:04:45.432126 11743 raft_consensus.cc:2229] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:45.432301 11743 raft_consensus.cc:2258] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:45.433128 11743 ts_tablet_manager.cc:1905] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:45.434717 11743 ts_tablet_manager.cc:1918] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:45.434801 11743 log.cc:1196] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/d99934e4cbe442acb04be51d5ff05f33
I20260811 01:04:45.435034 11743 ts_tablet_manager.cc:1939] T d99934e4cbe442acb04be51d5ff05f33 P 95f5cc756f0c47748444b89b8601f71a: Deleting consensus metadata
I20260811 01:04:45.435535 10910 catalog_manager.cc:4841] TS 95f5cc756f0c47748444b89b8601f71a (127.13.30.131:42415): tablet d99934e4cbe442acb04be51d5ff05f33 (table test-table [id=21827119e80f4b03acf5502e5b4439cc]) successfully deleted
W20260811 01:04:45.438032 10911 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:35697 (error 108)
I20260811 01:04:45.438279 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 11245
I20260811 01:04:45.447544 11695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.444848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:35697 (local address 127.0.0.1:47290)
0811 01:04:45.447374 (+ 2526us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:45.447481 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:35697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2483}
W20260811 01:04:45.450433 10911 catalog_manager.cc:4584] TS b59336eccd7447f59a5ea7eb38734e54 (127.13.30.129:35697): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d99934e4cbe442acb04be51d5ff05f33: Network error: Client connection negotiation failed: client connection to 127.13.30.129:35697: connect: Connection refused (error 111)
I20260811 01:04:45.459038 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 11458
I20260811 01:04:45.482502 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 10879
2026-08-11T01:04:45Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2253 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T01:04:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:04:45Z Disabled control of system clock
I20260811 01:04:45.520992 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:45189
--webserver_interface=127.13.30.190
--webserver_port=0
--builtin_ntp_servers=127.13.30.148:39885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:45189
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:04:45.609846 11753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:45.610123 11753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:45.610157 11753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:45.611497 11753 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:04:45.611553 11753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:45.611570 11753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:45.611588 11753 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:04:45.611604 11753 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:04:45.613276 11753 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:45189
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:45189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11753
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:45.613615 11753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:45.613968 11753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:45.619205 11762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:45.619196 11766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:45.619196 11763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:45.619796 11753 server_base.cc:1034] running on GCE node
I20260811 01:04:45.620102 11753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:45.620416 11753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:45.621551 11753 hybrid_clock.cc:648] HybridClock initialized: now 1786410285621529 us; error 31 us; skew 500 ppm
I20260811 01:04:45.623080 11753 webserver.cc:460] Webserver started at http://127.13.30.190:38197/ using document root <none> and password file <none>
I20260811 01:04:45.623360 11753 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:45.623414 11753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:45.623558 11753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:45.624707 11753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "9c49867d44fd48de9f825c8e5a92bb81"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "a081e7227ca0f668fb1f6b11e47e43b8"
server_key_iv: "1cff210d5d2a39946b72e5263ce916a9"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.625054 11753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "9c49867d44fd48de9f825c8e5a92bb81"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "a081e7227ca0f668fb1f6b11e47e43b8"
server_key_iv: "1cff210d5d2a39946b72e5263ce916a9"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.626459 11753 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:04:45.627247 11776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:45.627413 11753 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:45.627507 11753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "9c49867d44fd48de9f825c8e5a92bb81"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "a081e7227ca0f668fb1f6b11e47e43b8"
server_key_iv: "1cff210d5d2a39946b72e5263ce916a9"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.627576 11753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:45.639202 11753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:45.639595 11753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:45.639743 11753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:45.644063 11753 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:45189
I20260811 01:04:45.644114 11855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:45189 every 8 connection(s)
I20260811 01:04:45.644477 11753 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:04:45.645601 11856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:45.646620 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 11753
I20260811 01:04:45.646718 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:04:45.646914 13434 external_mini_cluster.cc:1428] Setting key 8aabcd08568adc42d135413bce546992
I20260811 01:04:45.648342 11856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81: Bootstrap starting.
I20260811 01:04:45.648995 11856 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:45.649276 11856 log.cc:824] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:45.650125 11856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81: No bootstrap required, opened a new log
I20260811 01:04:45.652493 11856 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c49867d44fd48de9f825c8e5a92bb81" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45189 } }
I20260811 01:04:45.652658 11856 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:45.652667 11861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.647468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51438 (local address 127.13.30.190:45189)
0811 01:04:45.647681 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:45.647689 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:45.647728 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:04:45.648166 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:45.648173 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:45.648233 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:45.648362 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:45.648602 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.649637 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.650739 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.651159 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.651255 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.651998 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:45.652002 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:45.652002 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:45.652171 (+ 169us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:45.652207 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:45.652219 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:45.652268 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:45.652355 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 01:04:45.652426 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":87,"threads_started":1}
I20260811 01:04:45.652704 11856 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c49867d44fd48de9f825c8e5a92bb81, State: Initialized, Role: FOLLOWER
I20260811 01:04:45.652823 11856 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c49867d44fd48de9f825c8e5a92bb81" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45189 } }
I20260811 01:04:45.652889 11856 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:04:45.652925 11856 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:04:45.652963 11856 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:45.653713 11856 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c49867d44fd48de9f825c8e5a92bb81" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45189 } }
I20260811 01:04:45.653817 11856 leader_election.cc:302] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c49867d44fd48de9f825c8e5a92bb81; no voters:
I20260811 01:04:45.653963 11856 leader_election.cc:288] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:04:45.654021 11868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:45.654187 11868 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [term 1 LEADER]: Becoming Leader. State: Replica: 9c49867d44fd48de9f825c8e5a92bb81, State: Running, Role: LEADER
I20260811 01:04:45.654271 11856 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:04:45.654276 11868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c49867d44fd48de9f825c8e5a92bb81" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45189 } }
I20260811 01:04:45.654742 11869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c49867d44fd48de9f825c8e5a92bb81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c49867d44fd48de9f825c8e5a92bb81" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45189 } } }
I20260811 01:04:45.654747 11870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c49867d44fd48de9f825c8e5a92bb81. Latest consensus state: current_term: 1 leader_uuid: "9c49867d44fd48de9f825c8e5a92bb81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c49867d44fd48de9f825c8e5a92bb81" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 45189 } } }
I20260811 01:04:45.654946 11870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:45.655158 11869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81 [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:45.655164 11882 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:04:45.655929 11882 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:04:45.657583 11882 catalog_manager.cc:1347] Generated new cluster ID: 6c93f9e459134a348001e9ebd5fd67ad
I20260811 01:04:45.657634 11882 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:04:45.663532 11882 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:04:45.664099 11882 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:04:45.676045 11882 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81: Generated new TSK 0
I20260811 01:04:45.676363 11882 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:04:45.686050 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45189
--builtin_ntp_servers=127.13.30.148:39885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:04:45.806388 11904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:45.806677 11904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:45.806707 11904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:45.808480 11904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:45.808549 11904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:45.808580 11904 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:04:45.810335 11904 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11904
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:45.810652 11904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:45.811012 11904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:45.817611 11913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:45.817719 11909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:45.817667 11911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:45.817976 11904 server_base.cc:1034] running on GCE node
I20260811 01:04:45.818303 11904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:45.818601 11904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:45.819795 11904 hybrid_clock.cc:648] HybridClock initialized: now 1786410285819774 us; error 34 us; skew 500 ppm
I20260811 01:04:45.821630 11904 webserver.cc:460] Webserver started at http://127.13.30.129:39257/ using document root <none> and password file <none>
I20260811 01:04:45.821919 11904 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:45.821969 11904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:45.822122 11904 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:45.823351 11904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "f4908a6535b7461bbc1463a8f4373dcb"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "8c2afd9ea413a177b104ea45e8db46ba"
server_key_iv: "43cc4dc2460939392e5ca3743f44f341"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.823727 11904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "f4908a6535b7461bbc1463a8f4373dcb"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "8c2afd9ea413a177b104ea45e8db46ba"
server_key_iv: "43cc4dc2460939392e5ca3743f44f341"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.825117 11904 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:04:45.825991 11922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:45.826152 11904 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 01:04:45.826238 11904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "f4908a6535b7461bbc1463a8f4373dcb"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "8c2afd9ea413a177b104ea45e8db46ba"
server_key_iv: "43cc4dc2460939392e5ca3743f44f341"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.826313 11904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:45.848088 11904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:45.848433 11904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:45.848573 11904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:45.848805 11904 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:45.849174 11904 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:45.849211 11904 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:45.849234 11904 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:45.849246 11904 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:45.855075 11904 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:33263
I20260811 01:04:45.855142 12103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:33263 every 8 connection(s)
I20260811 01:04:45.855515 11904 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:04:45.860934 11861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.856292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:40967 (local address 127.13.30.190:45189)
0811 01:04:45.856378 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:45.856380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:45.856575 (+ 195us) server_negotiation.cc:407] Connection header received
0811 01:04:45.857088 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:45.857089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:45.857105 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:45.857161 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:45.857882 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.858403 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.859541 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.859743 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.859812 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.860689 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:45.860690 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:45.860691 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:45.860697 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:45.860714 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:45.860718 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:45.860766 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:45.860835 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 01:04:45.860862 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 01:04:45.861151 12106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.856263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45189 (local address 127.13.30.129:40967)
0811 01:04:45.856449 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:45.856490 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:45.857002 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:45.857217 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:45.857220 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:45.857230 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:45.857806 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.857811 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.858505 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.858506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.859411 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:45.859416 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:45.859823 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:45.859823 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:45.859939 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:45.860527 (+ 588us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:04:45.860528 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:45.860561 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:04:45.860588 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:45.860775 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:45.860778 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:45.860781 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:04:45.860828 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 01:04:45.860923 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":79,"threads_started":1}
I20260811 01:04:45.861663 12104 heartbeater.cc:347] Connected to a master server at 127.13.30.190:45189
I20260811 01:04:45.861760 12104 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:45.861935 12104 heartbeater.cc:511] Master 127.13.30.190:45189 requested a full tablet report, sending...
I20260811 01:04:45.862473 11809 ts_manager.cc:194] Registered new tserver with Master: f4908a6535b7461bbc1463a8f4373dcb (127.13.30.129:33263)
I20260811 01:04:45.863102 11809 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.30.129:40967
I20260811 01:04:45.864253 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 11904
I20260811 01:04:45.864347 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:04:45.864540 13434 external_mini_cluster.cc:1428] Setting key a600d7b48e398b5d9b2ec06fc2f16c90
I20260811 01:04:45.865460 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45189
--builtin_ntp_servers=127.13.30.148:39885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:04:45.953492 12107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:45.953794 12107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:45.953835 12107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:45.955250 12107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:45.955310 12107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:45.955353 12107 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:04:45.956969 12107 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:45.957279 12107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:45.957664 12107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:45.963225 12116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:45.963228 12119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:45.963228 12117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:45.963506 12107 server_base.cc:1034] running on GCE node
I20260811 01:04:45.963795 12107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:45.964069 12107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:45.965322 12107 hybrid_clock.cc:648] HybridClock initialized: now 1786410285965265 us; error 74 us; skew 500 ppm
I20260811 01:04:45.967129 12107 webserver.cc:460] Webserver started at http://127.13.30.130:33529/ using document root <none> and password file <none>
I20260811 01:04:45.967394 12107 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:45.967445 12107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:45.967586 12107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:45.968735 12107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "8c1a94c4c61d467a8dde737a8d05309c"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "b7737d115828094ced14d118a581d041"
server_key_iv: "2ea1f7dd454d21e60f4746e9bd0274d1"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.969101 12107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "8c1a94c4c61d467a8dde737a8d05309c"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "b7737d115828094ced14d118a581d041"
server_key_iv: "2ea1f7dd454d21e60f4746e9bd0274d1"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.970568 12107 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 01:04:45.971561 12127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:45.971841 12107 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:45.971959 12107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "8c1a94c4c61d467a8dde737a8d05309c"
format_stamp: "Formatted at 2026-08-11 01:04:45 on dist-test-slave-42z9"
server_key: "b7737d115828094ced14d118a581d041"
server_key_iv: "2ea1f7dd454d21e60f4746e9bd0274d1"
server_key_version: "encryptionkey@0"
I20260811 01:04:45.972036 12107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:45.990202 12107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:45.990562 12107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:45.990700 12107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:45.990939 12107 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:45.991308 12107 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:45.991343 12107 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:45.991374 12107 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:45.991391 12107 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:45.998122 12107 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:41859
I20260811 01:04:45.998181 12324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:41859 every 8 connection(s)
I20260811 01:04:45.998529 12107 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:04:46.001878 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 12107
I20260811 01:04:46.001969 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:04:46.002156 13434 external_mini_cluster.cc:1428] Setting key 9d59573b72022366c73efb328fabfa6b
I20260811 01:04:46.003178 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45189
--builtin_ntp_servers=127.13.30.148:39885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 01:04:46.003957 11861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.999273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:33313 (local address 127.13.30.190:45189)
0811 01:04:45.999332 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:45.999335 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:45.999571 (+ 236us) server_negotiation.cc:407] Connection header received
0811 01:04:46.000104 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:46.000105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:46.000119 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:46.000172 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:46.000888 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.001390 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.002515 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.002712 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.002767 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.003715 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:46.003716 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:46.003717 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:46.003722 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:46.003738 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:46.003743 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:46.003782 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:46.003870 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 01:04:46.003896 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 01:04:46.004222 12329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:45.999246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45189 (local address 127.13.30.130:33313)
0811 01:04:45.999441 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:45.999483 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:46.000000 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:46.000245 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:46.000249 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:46.000260 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:46.000787 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:46.000792 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.001507 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.001508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:46.002439 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:46.002442 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.002788 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.002789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:46.002960 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.003542 (+ 582us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:04:46.003543 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:46.003582 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:04:46.003611 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:46.003795 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:46.003801 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:46.003804 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:04:46.003871 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 01:04:46.003999 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":90,"threads_started":1}
I20260811 01:04:46.004752 12325 heartbeater.cc:347] Connected to a master server at 127.13.30.190:45189
I20260811 01:04:46.004854 12325 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:46.005084 12325 heartbeater.cc:511] Master 127.13.30.190:45189 requested a full tablet report, sending...
I20260811 01:04:46.005489 11809 ts_manager.cc:194] Registered new tserver with Master: 8c1a94c4c61d467a8dde737a8d05309c (127.13.30.130:41859)
I20260811 01:04:46.005980 11809 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.30.130:33313
W20260811 01:04:46.089960 12332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:46.090211 12332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:46.090236 12332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:46.091467 12332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:46.091531 12332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:46.091560 12332 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:04:46.093010 12332 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:45189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:46.093277 12332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:46.093647 12332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:46.099426 12346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:46.099409 12344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:46.099402 12350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:46.099694 12332 server_base.cc:1034] running on GCE node
I20260811 01:04:46.099959 12332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:46.100215 12332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:46.101387 12332 hybrid_clock.cc:648] HybridClock initialized: now 1786410286101371 us; error 31 us; skew 500 ppm
I20260811 01:04:46.102857 12332 webserver.cc:460] Webserver started at http://127.13.30.131:41473/ using document root <none> and password file <none>
I20260811 01:04:46.103104 12332 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:46.103159 12332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:46.103302 12332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:46.104452 12332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "5582e5829202449e92c677b745bac845"
format_stamp: "Formatted at 2026-08-11 01:04:46 on dist-test-slave-42z9"
server_key: "04fecad069e50c246b75a4fe0c60386e"
server_key_iv: "30709ed89a6475110e311a018e7a9d34"
server_key_version: "encryptionkey@0"
I20260811 01:04:46.104827 12332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "5582e5829202449e92c677b745bac845"
format_stamp: "Formatted at 2026-08-11 01:04:46 on dist-test-slave-42z9"
server_key: "04fecad069e50c246b75a4fe0c60386e"
server_key_iv: "30709ed89a6475110e311a018e7a9d34"
server_key_version: "encryptionkey@0"
I20260811 01:04:46.106326 12332 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:04:46.107153 12364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:46.107306 12332 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:46.107404 12332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "5582e5829202449e92c677b745bac845"
format_stamp: "Formatted at 2026-08-11 01:04:46 on dist-test-slave-42z9"
server_key: "04fecad069e50c246b75a4fe0c60386e"
server_key_iv: "30709ed89a6475110e311a018e7a9d34"
server_key_version: "encryptionkey@0"
I20260811 01:04:46.107472 12332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:46.133329 12332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:46.133812 12332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:46.133973 12332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:46.134292 12332 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:46.134732 12332 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:46.134771 12332 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:46.134807 12332 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:46.134828 12332 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:46.142534 12332 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:36347
I20260811 01:04:46.142601 12539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:36347 every 8 connection(s)
I20260811 01:04:46.142998 12332 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:04:46.148766 11861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.143895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:49037 (local address 127.13.30.190:45189)
0811 01:04:46.143971 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:46.143973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:46.144247 (+ 274us) server_negotiation.cc:407] Connection header received
0811 01:04:46.144796 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:46.144798 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:46.144810 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:46.144869 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:46.145732 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.146237 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.147415 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.147623 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.147690 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.148538 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:46.148539 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:46.148539 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:46.148544 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:46.148560 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:46.148563 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:46.148602 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:46.148667 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 01:04:46.148693 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 01:04:46.148977 12543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.143826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:45189 (local address 127.13.30.131:49037)
0811 01:04:46.144117 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:46.144161 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:46.144684 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:46.144942 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:46.144946 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:46.144957 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:46.145565 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:46.145570 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.146474 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.146474 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:46.147310 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:46.147312 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.147702 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.147703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:46.147820 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.148390 (+ 570us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:04:46.148391 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:46.148426 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:04:46.148455 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:46.148609 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:46.148612 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:46.148614 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 01:04:46.148663 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 01:04:46.148755 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":118,"threads_started":1}
I20260811 01:04:46.149506 12541 heartbeater.cc:347] Connected to a master server at 127.13.30.190:45189
I20260811 01:04:46.149617 12541 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:46.149833 12541 heartbeater.cc:511] Master 127.13.30.190:45189 requested a full tablet report, sending...
I20260811 01:04:46.150278 11809 ts_manager.cc:194] Registered new tserver with Master: 5582e5829202449e92c677b745bac845 (127.13.30.131:36347)
I20260811 01:04:46.150596 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 12332
I20260811 01:04:46.150640 11809 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.30.131:49037
I20260811 01:04:46.150692 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:04:46.150911 13434 external_mini_cluster.cc:1428] Setting key 2ed4e0fa43cf260e415f8ed4264a1244
I20260811 01:04:46.151737 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:04:46.156289 11861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.153280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51454 (local address 127.13.30.190:45189)
0811 01:04:46.153345 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:46.153347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:46.153357 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:04:46.153419 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:46.153420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:46.153429 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:46.153503 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:46.153657 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.154191 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.154963 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.155166 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.155222 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.156014 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:46.156016 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:46.156016 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:46.156022 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:46.156038 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:46.156041 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:46.156109 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:46.156182 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 01:04:46.156194 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 01:04:46.158190 11809 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51454:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:04:46.159932 11809 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:04:46.166531 12559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.162457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:41859 (local address 127.0.0.1:33796)
0811 01:04:46.162647 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:46.162685 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:46.162749 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:46.163258 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:46.163259 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:46.163261 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:46.163327 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:46.163329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.164207 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.164208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:46.165490 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:46.165501 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.166204 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.166204 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:46.166292 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.166308 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 01:04:46.166382 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 01:04:46.166439 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":92,"threads_started":1}
I20260811 01:04:46.166651 12562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.162722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60010 (local address 127.13.30.131:36347)
0811 01:04:46.162902 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:46.162906 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:46.162978 (+ 72us) server_negotiation.cc:407] Connection header received
0811 01:04:46.163054 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:46.163056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:46.163072 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:46.163148 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:46.163326 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.164444 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.165564 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.166277 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.166366 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.166455 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:46.166515 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 01:04:46.166557 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":79,"threads_started":1}
I20260811 01:04:46.166795 12561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.162573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33796 (local address 127.13.30.130:41859)
0811 01:04:46.163102 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:46.163106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:46.163115 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:04:46.163149 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:46.163151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:46.163165 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:46.163398 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:46.163452 (+ 54us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.164130 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.165590 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.166124 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.166190 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.166289 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:46.166660 (+ 371us) server_negotiation.cc:299] Negotiation successful
0811 01:04:46.166713 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":96,"threads_started":1}
I20260811 01:04:46.166918 12563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.162733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40944 (local address 127.13.30.129:33263)
0811 01:04:46.162898 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:46.162903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:46.162914 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:04:46.162956 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:46.162958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:46.162974 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:46.163051 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:46.163267 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.164445 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.165699 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.166399 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.166459 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.166537 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:46.166791 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 01:04:46.166838 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":97,"threads_started":1}
I20260811 01:04:46.167171 12560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.162468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:36347 (local address 127.0.0.1:60010)
0811 01:04:46.162908 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:46.162917 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:46.162972 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:46.163206 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:46.163207 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:46.163209 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:46.163252 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:46.163253 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.164543 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.164544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:46.165496 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:46.165499 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.166384 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.166386 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:46.166439 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.166443 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:04:46.166503 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 01:04:46.166537 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":5,"thread_start_us":61,"threads_started":1}
I20260811 01:04:46.167186 12557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.162457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:33263 (local address 127.0.0.1:40944)
0811 01:04:46.162750 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:46.162760 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:46.162817 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:46.163070 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:46.163074 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:46.163076 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:46.163178 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:46.163181 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.164530 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.164531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:46.165624 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:46.165626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.166573 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.166575 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:46.166641 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.166645 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:04:46.166694 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 01:04:46.166740 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":24,"thread_start_us":90,"threads_started":1}
I20260811 01:04:46.167579 12209 tablet_service.cc:1467] Processing CreateTablet for tablet f98e71f6ef294585ad4da0bd8e9f2a52 (DEFAULT_TABLE table=test-table [id=eba510d071ca4032b146412ea2e942df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:46.167800 12434 tablet_service.cc:1467] Processing CreateTablet for tablet f98e71f6ef294585ad4da0bd8e9f2a52 (DEFAULT_TABLE table=test-table [id=eba510d071ca4032b146412ea2e942df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:46.167997 12209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f98e71f6ef294585ad4da0bd8e9f2a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:46.168140 12434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f98e71f6ef294585ad4da0bd8e9f2a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:46.170985 12564 tablet_bootstrap.cc:492] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845: Bootstrap starting.
I20260811 01:04:46.170990 12565 tablet_bootstrap.cc:492] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c: Bootstrap starting.
I20260811 01:04:46.171639 12565 tablet_bootstrap.cc:654] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:46.171747 12564 tablet_bootstrap.cc:654] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:46.171926 12565 log.cc:824] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:46.171784 11999 tablet_service.cc:1467] Processing CreateTablet for tablet f98e71f6ef294585ad4da0bd8e9f2a52 (DEFAULT_TABLE table=test-table [id=eba510d071ca4032b146412ea2e942df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:46.172125 12564 log.cc:824] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:46.172163 11999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f98e71f6ef294585ad4da0bd8e9f2a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:46.172590 12565 tablet_bootstrap.cc:492] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c: No bootstrap required, opened a new log
I20260811 01:04:46.172700 12565 ts_tablet_manager.cc:1397] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:04:46.172880 12564 tablet_bootstrap.cc:492] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845: No bootstrap required, opened a new log
I20260811 01:04:46.172948 12564 ts_tablet_manager.cc:1397] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:04:46.174856 12568 tablet_bootstrap.cc:492] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb: Bootstrap starting.
I20260811 01:04:46.175562 12568 tablet_bootstrap.cc:654] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:46.175516 12564 raft_consensus.cc:348] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a94c4c61d467a8dde737a8d05309c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 41859 } } peers { permanent_uuid: "f4908a6535b7461bbc1463a8f4373dcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33263 } } peers { permanent_uuid: "5582e5829202449e92c677b745bac845" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36347 } }
I20260811 01:04:46.175694 12564 raft_consensus.cc:374] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:46.175738 12564 raft_consensus.cc:729] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5582e5829202449e92c677b745bac845, State: Initialized, Role: FOLLOWER
I20260811 01:04:46.175784 12565 raft_consensus.cc:348] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a94c4c61d467a8dde737a8d05309c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 41859 } } peers { permanent_uuid: "f4908a6535b7461bbc1463a8f4373dcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33263 } } peers { permanent_uuid: "5582e5829202449e92c677b745bac845" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36347 } }
I20260811 01:04:46.175856 12564 consensus_queue.cc:260] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a94c4c61d467a8dde737a8d05309c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 41859 } } peers { permanent_uuid: "f4908a6535b7461bbc1463a8f4373dcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33263 } } peers { permanent_uuid: "5582e5829202449e92c677b745bac845" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36347 } }
I20260811 01:04:46.175918 12568 log.cc:824] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:46.175937 12565 raft_consensus.cc:374] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:46.175973 12565 raft_consensus.cc:729] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c1a94c4c61d467a8dde737a8d05309c, State: Initialized, Role: FOLLOWER
I20260811 01:04:46.176123 12564 ts_tablet_manager.cc:1428] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:04:46.176100 12565 consensus_queue.cc:260] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a94c4c61d467a8dde737a8d05309c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 41859 } } peers { permanent_uuid: "f4908a6535b7461bbc1463a8f4373dcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33263 } } peers { permanent_uuid: "5582e5829202449e92c677b745bac845" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36347 } }
I20260811 01:04:46.176257 12541 heartbeater.cc:503] Master 127.13.30.190:45189 was elected leader, sending a full tablet report...
I20260811 01:04:46.176343 12565 ts_tablet_manager.cc:1428] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 01:04:46.176406 12325 heartbeater.cc:503] Master 127.13.30.190:45189 was elected leader, sending a full tablet report...
I20260811 01:04:46.177400 12568 tablet_bootstrap.cc:492] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb: No bootstrap required, opened a new log
I20260811 01:04:46.177500 12568 ts_tablet_manager.cc:1397] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 01:04:46.179468 12568 raft_consensus.cc:348] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a94c4c61d467a8dde737a8d05309c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 41859 } } peers { permanent_uuid: "f4908a6535b7461bbc1463a8f4373dcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33263 } } peers { permanent_uuid: "5582e5829202449e92c677b745bac845" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36347 } }
I20260811 01:04:46.179606 12568 raft_consensus.cc:374] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:46.179627 12568 raft_consensus.cc:729] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4908a6535b7461bbc1463a8f4373dcb, State: Initialized, Role: FOLLOWER
I20260811 01:04:46.179720 12568 consensus_queue.cc:260] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a94c4c61d467a8dde737a8d05309c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 41859 } } peers { permanent_uuid: "f4908a6535b7461bbc1463a8f4373dcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33263 } } peers { permanent_uuid: "5582e5829202449e92c677b745bac845" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36347 } }
I20260811 01:04:46.179967 12568 ts_tablet_manager.cc:1428] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 01:04:46.180039 12104 heartbeater.cc:503] Master 127.13.30.190:45189 was elected leader, sending a full tablet report...
I20260811 01:04:46.228559 12577 raft_consensus.cc:482] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:04:46.228821 12577 raft_consensus.cc:504] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a94c4c61d467a8dde737a8d05309c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 41859 } } peers { permanent_uuid: "f4908a6535b7461bbc1463a8f4373dcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33263 } } peers { permanent_uuid: "5582e5829202449e92c677b745bac845" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36347 } }
I20260811 01:04:46.229384 12577 leader_election.cc:288] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4908a6535b7461bbc1463a8f4373dcb (127.13.30.129:33263), 5582e5829202449e92c677b745bac845 (127.13.30.131:36347)
I20260811 01:04:46.232831 12562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.229787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:59305 (local address 127.13.30.131:36347)
0811 01:04:46.229893 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:46.229896 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:46.230045 (+ 149us) server_negotiation.cc:407] Connection header received
0811 01:04:46.230219 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:46.230220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:46.230229 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:46.230275 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:46.230464 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.231030 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.232085 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.232480 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.232553 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.232564 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:46.232707 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 01:04:46.232753 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:04:46.232827 12563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.229793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:58029 (local address 127.13.30.129:33263)
0811 01:04:46.229865 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:46.229868 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:46.229885 (+ 17us) server_negotiation.cc:407] Connection header received
0811 01:04:46.229930 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:46.229931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:46.229946 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:46.230058 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:46.230327 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.230917 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.232081 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.232465 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.232534 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.232544 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:46.232698 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 01:04:46.232742 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 01:04:46.232872 12329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.229643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:33263 (local address 127.13.30.130:58029)
0811 01:04:46.229728 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:46.229740 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:46.229794 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:46.230093 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:46.230095 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:46.230098 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:46.230206 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:46.230209 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.230997 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.230999 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:46.231981 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:46.231984 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.232551 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.232552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:46.232634 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.232637 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:04:46.232684 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 01:04:46.232742 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":11}
I20260811 01:04:46.233098 12579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.229677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:36347 (local address 127.13.30.130:59305)
0811 01:04:46.229967 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:46.229980 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:46.230095 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:46.230287 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:46.230288 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:46.230291 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:46.230396 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:46.230398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.231115 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.231117 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:46.231993 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:46.231995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.232560 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.232561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:46.232640 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.232643 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:04:46.232690 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 01:04:46.232740 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":140,"threads_started":1}
I20260811 01:04:46.233249 12027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f98e71f6ef294585ad4da0bd8e9f2a52" candidate_uuid: "8c1a94c4c61d467a8dde737a8d05309c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4908a6535b7461bbc1463a8f4373dcb" is_pre_election: true
I20260811 01:04:46.233480 12027 raft_consensus.cc:2454] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c1a94c4c61d467a8dde737a8d05309c in term 0.
I20260811 01:04:46.233647 12472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f98e71f6ef294585ad4da0bd8e9f2a52" candidate_uuid: "8c1a94c4c61d467a8dde737a8d05309c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5582e5829202449e92c677b745bac845" is_pre_election: true
I20260811 01:04:46.233819 12472 raft_consensus.cc:2454] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c1a94c4c61d467a8dde737a8d05309c in term 0.
I20260811 01:04:46.233892 12130 leader_election.cc:302] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c1a94c4c61d467a8dde737a8d05309c, f4908a6535b7461bbc1463a8f4373dcb; no voters:
I20260811 01:04:46.234026 12577 raft_consensus.cc:2781] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:04:46.234094 12577 raft_consensus.cc:482] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:04:46.234115 12577 raft_consensus.cc:3037] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:46.235018 12577 raft_consensus.cc:504] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a94c4c61d467a8dde737a8d05309c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 41859 } } peers { permanent_uuid: "f4908a6535b7461bbc1463a8f4373dcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33263 } } peers { permanent_uuid: "5582e5829202449e92c677b745bac845" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36347 } }
I20260811 01:04:46.235174 12577 leader_election.cc:288] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [CANDIDATE]: Term 1 election: Requested vote from peers f4908a6535b7461bbc1463a8f4373dcb (127.13.30.129:33263), 5582e5829202449e92c677b745bac845 (127.13.30.131:36347)
I20260811 01:04:46.235392 12027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f98e71f6ef294585ad4da0bd8e9f2a52" candidate_uuid: "8c1a94c4c61d467a8dde737a8d05309c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4908a6535b7461bbc1463a8f4373dcb"
I20260811 01:04:46.235520 12027 raft_consensus.cc:3037] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:46.235579 12472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f98e71f6ef294585ad4da0bd8e9f2a52" candidate_uuid: "8c1a94c4c61d467a8dde737a8d05309c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5582e5829202449e92c677b745bac845"
I20260811 01:04:46.235721 12472 raft_consensus.cc:3037] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:46.236413 12027 raft_consensus.cc:2454] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c1a94c4c61d467a8dde737a8d05309c in term 1.
I20260811 01:04:46.236639 12130 leader_election.cc:302] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c1a94c4c61d467a8dde737a8d05309c, f4908a6535b7461bbc1463a8f4373dcb; no voters:
I20260811 01:04:46.236754 12472 raft_consensus.cc:2454] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c1a94c4c61d467a8dde737a8d05309c in term 1.
I20260811 01:04:46.236829 12577 raft_consensus.cc:2781] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:46.237047 12577 raft_consensus.cc:686] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [term 1 LEADER]: Becoming Leader. State: Replica: 8c1a94c4c61d467a8dde737a8d05309c, State: Running, Role: LEADER
I20260811 01:04:46.237162 12577 consensus_queue.cc:237] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a94c4c61d467a8dde737a8d05309c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 41859 } } peers { permanent_uuid: "f4908a6535b7461bbc1463a8f4373dcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33263 } } peers { permanent_uuid: "5582e5829202449e92c677b745bac845" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36347 } }
I20260811 01:04:46.238108 11809 catalog_manager.cc:5495] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c1a94c4c61d467a8dde737a8d05309c (127.13.30.130). New cstate: current_term: 1 leader_uuid: "8c1a94c4c61d467a8dde737a8d05309c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a94c4c61d467a8dde737a8d05309c" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 41859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4908a6535b7461bbc1463a8f4373dcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5582e5829202449e92c677b745bac845" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36347 } health_report { overall_health: UNKNOWN } } }
W20260811 01:04:46.249130 12326 tablet.cc:2369] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:04:46.262220 12561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.259680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33812 (local address 127.13.30.130:41859)
0811 01:04:46.259745 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:46.259748 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:46.259759 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:04:46.259855 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:46.259855 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:46.259881 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:46.259948 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:04:46.260100 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.260584 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.261359 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:46.261604 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:46.261663 (+ 59us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:46.261831 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:04:46.261930 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:04:46.262021 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:46.262080 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 01:04:46.262091 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 01:04:46.264297 12472 raft_consensus.cc:1261] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845 [term 1 FOLLOWER]: Refusing update from remote peer 8c1a94c4c61d467a8dde737a8d05309c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:04:46.264295 12027 raft_consensus.cc:1261] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb [term 1 FOLLOWER]: Refusing update from remote peer 8c1a94c4c61d467a8dde737a8d05309c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:04:46.264689 12582 consensus_queue.cc:1035] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4908a6535b7461bbc1463a8f4373dcb" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:04:46.264832 12577 consensus_queue.cc:1035] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5582e5829202449e92c677b745bac845" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:04:46.268267 12593 mvcc.cc:205] Tried to move back new op lower bound from 7317136532535517184 to 7317136532428161024. Current Snapshot: MvccSnapshot[applied={T|T < 7317136532535517184}]
I20260811 01:04:46.268412 12594 mvcc.cc:205] Tried to move back new op lower bound from 7317136532535517184 to 7317136532428161024. Current Snapshot: MvccSnapshot[applied={T|T < 7317136532535517184 or (T in {7317136532535517184})}]
I20260811 01:04:46.269778 11809 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:04:46.269888 11809 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:04:46.270706 11809 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c49867d44fd48de9f825c8e5a92bb81: Sending DeleteTablet for 3 replicas of tablet f98e71f6ef294585ad4da0bd8e9f2a52
I20260811 01:04:46.271059 12434 tablet_service.cc:1514] Processing DeleteTablet for tablet f98e71f6ef294585ad4da0bd8e9f2a52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:46 UTC) from {username='slave'} at 127.0.0.1:60010
I20260811 01:04:46.271085 11999 tablet_service.cc:1514] Processing DeleteTablet for tablet f98e71f6ef294585ad4da0bd8e9f2a52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:46 UTC) from {username='slave'} at 127.0.0.1:40944
I20260811 01:04:46.271318 12605 tablet_replica.cc:330] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845: stopping tablet replica
I20260811 01:04:46.271328 12606 tablet_replica.cc:330] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb: stopping tablet replica
I20260811 01:04:46.271425 12605 raft_consensus.cc:2229] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:46.271425 12606 raft_consensus.cc:2229] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:46.271536 12606 raft_consensus.cc:2258] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:46.271536 12605 raft_consensus.cc:2258] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:46.271603 12209 tablet_service.cc:1514] Processing DeleteTablet for tablet f98e71f6ef294585ad4da0bd8e9f2a52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:46 UTC) from {username='slave'} at 127.0.0.1:33796
I20260811 01:04:46.272029 12606 ts_tablet_manager.cc:1905] T f98e71f6ef294585ad4da0bd8e9f2a52 P f4908a6535b7461bbc1463a8f4373dcb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:46.272030 12605 ts_tablet_manager.cc:1905] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:46.272264 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 11904
I20260811 01:04:46.273715 12605 ts_tablet_manager.cc:1918] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:46.273777 12605 log.cc:1196] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/f98e71f6ef294585ad4da0bd8e9f2a52
I20260811 01:04:46.273970 12605 ts_tablet_manager.cc:1939] T f98e71f6ef294585ad4da0bd8e9f2a52 P 5582e5829202449e92c677b745bac845: Deleting consensus metadata
I20260811 01:04:46.274425 11785 catalog_manager.cc:4841] TS 5582e5829202449e92c677b745bac845 (127.13.30.131:36347): tablet f98e71f6ef294585ad4da0bd8e9f2a52 (table test-table [id=eba510d071ca4032b146412ea2e942df]) successfully deleted
I20260811 01:04:46.280830 12609 tablet_replica.cc:330] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c: stopping tablet replica
I20260811 01:04:46.280987 12609 raft_consensus.cc:2229] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:04:46.281132 12609 raft_consensus.cc:2258] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:46.281632 12609 ts_tablet_manager.cc:1905] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:46.283257 12609 ts_tablet_manager.cc:1918] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:46.283329 12609 log.cc:1196] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/f98e71f6ef294585ad4da0bd8e9f2a52
I20260811 01:04:46.283560 12609 ts_tablet_manager.cc:1939] T f98e71f6ef294585ad4da0bd8e9f2a52 P 8c1a94c4c61d467a8dde737a8d05309c: Deleting consensus metadata
I20260811 01:04:46.284094 11779 catalog_manager.cc:4841] TS 8c1a94c4c61d467a8dde737a8d05309c (127.13.30.130:41859): tablet f98e71f6ef294585ad4da0bd8e9f2a52 (table test-table [id=eba510d071ca4032b146412ea2e942df]) successfully deleted
W20260811 01:04:46.289220 11781 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:33263 (error 108)
I20260811 01:04:46.289424 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 12107
I20260811 01:04:46.301191 12560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:46.301010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:33263 (local address 127.0.0.1:40960)
0811 01:04:46.301073 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:46.301147 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:33263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 01:04:46.301360 11781 catalog_manager.cc:4584] TS f4908a6535b7461bbc1463a8f4373dcb (127.13.30.129:33263): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f98e71f6ef294585ad4da0bd8e9f2a52: Network error: Client connection negotiation failed: client connection to 127.13.30.129:33263: connect: Connection refused (error 111)
I20260811 01:04:46.305720 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 12332
I20260811 01:04:46.313885 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 11753
2026-08-11T01:04:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (833 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:04:46 dist-test-slave-42z9 krb5kdc[12615](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:04:46 dist-test-slave-42z9 krb5kdc[12615](info): set up 2 sockets
Aug 11 01:04:46 dist-test-slave-42z9 krb5kdc[12615](info): commencing operation
krb5kdc: starting...
W20260811 01:04:47.512852 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:04:47 dist-test-slave-42z9 krb5kdc[12615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:04:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:04:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:04:47.652875 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:34607
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:34855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:34607
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:47.740557 12634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:47.740815 12634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:47.740852 12634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:47.742141 12634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:04:47.742190 12634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:47.742209 12634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:47.742226 12634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:04:47.742242 12634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:04:47.743881 12634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:34607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:34607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:47.744153 12634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:47.744392 12634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:47.749433 12646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:47.749572 12639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:47.749776 12634 server_base.cc:1034] running on GCE node
W20260811 01:04:47.749877 12642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:47.750370 12634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:47.750797 12634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:47.752002 12634 hybrid_clock.cc:648] HybridClock initialized: now 1786410287751967 us; error 54 us; skew 500 ppm
Aug 11 01:04:47 dist-test-slave-42z9 krb5kdc[12615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410287, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:47.755523 12634 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:04:47.756075 12634 webserver.cc:460] Webserver started at http://127.13.30.190:38751/ using document root <none> and password file <none>
I20260811 01:04:47.756300 12634 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:47.756352 12634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:47.756614 12634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:47.758000 12634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "a70acf7fad5a4544b2751e2f778a7c8b"
format_stamp: "Formatted at 2026-08-11 01:04:47 on dist-test-slave-42z9"
server_key: "fcc927e85ad1fbd682c8900e142d32b1"
server_key_iv: "81e1110920ddcc19fa0bc6a1937be8c4"
server_key_version: "encryptionkey@0"
I20260811 01:04:47.758363 12634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "a70acf7fad5a4544b2751e2f778a7c8b"
format_stamp: "Formatted at 2026-08-11 01:04:47 on dist-test-slave-42z9"
server_key: "fcc927e85ad1fbd682c8900e142d32b1"
server_key_iv: "81e1110920ddcc19fa0bc6a1937be8c4"
server_key_version: "encryptionkey@0"
I20260811 01:04:47.759956 12634 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:04:47.761102 12662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:47.761361 12634 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:47.761502 12634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "a70acf7fad5a4544b2751e2f778a7c8b"
format_stamp: "Formatted at 2026-08-11 01:04:47 on dist-test-slave-42z9"
server_key: "fcc927e85ad1fbd682c8900e142d32b1"
server_key_iv: "81e1110920ddcc19fa0bc6a1937be8c4"
server_key_version: "encryptionkey@0"
I20260811 01:04:47.761590 12634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:47.774418 12634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:47.776804 12634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:47.776965 12634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:47.781193 12634 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:34607
I20260811 01:04:47.781255 12744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:34607 every 8 connection(s)
I20260811 01:04:47.781682 12634 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:04:47.782614 12745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:47.785063 12745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b: Bootstrap starting.
I20260811 01:04:47.785718 12745 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:47.785975 12745 log.cc:824] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:47.786764 12745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b: No bootstrap required, opened a new log
I20260811 01:04:47.788411 12745 raft_consensus.cc:348] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a70acf7fad5a4544b2751e2f778a7c8b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34607 } }
I20260811 01:04:47.788586 12745 raft_consensus.cc:374] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:47.788612 12745 raft_consensus.cc:729] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70acf7fad5a4544b2751e2f778a7c8b, State: Initialized, Role: FOLLOWER
I20260811 01:04:47.788739 12745 consensus_queue.cc:260] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a70acf7fad5a4544b2751e2f778a7c8b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34607 } }
I20260811 01:04:47.788827 12745 raft_consensus.cc:388] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:04:47.788872 12745 raft_consensus.cc:482] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:04:47.788918 12745 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:47.789579 12745 raft_consensus.cc:504] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a70acf7fad5a4544b2751e2f778a7c8b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34607 } }
I20260811 01:04:47.789690 12745 leader_election.cc:302] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a70acf7fad5a4544b2751e2f778a7c8b; no voters:
I20260811 01:04:47.789798 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 12634
I20260811 01:04:47.789894 12745 leader_election.cc:288] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:04:47.789927 12748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:47.789948 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:04:47.790063 12748 raft_consensus.cc:686] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [term 1 LEADER]: Becoming Leader. State: Replica: a70acf7fad5a4544b2751e2f778a7c8b, State: Running, Role: LEADER
I20260811 01:04:47.790207 12745 sys_catalog.cc:564] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:04:47.790162 12748 consensus_queue.cc:237] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a70acf7fad5a4544b2751e2f778a7c8b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34607 } }
I20260811 01:04:47.790335 13434 external_mini_cluster.cc:1428] Setting key d6e30dc270fbd1fca8e2ba243e07189b
I20260811 01:04:47.790666 12748 sys_catalog.cc:455] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a70acf7fad5a4544b2751e2f778a7c8b. Latest consensus state: current_term: 1 leader_uuid: "a70acf7fad5a4544b2751e2f778a7c8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a70acf7fad5a4544b2751e2f778a7c8b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34607 } } }
I20260811 01:04:47.790766 12748 sys_catalog.cc:458] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:47.791101 12761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:04:47.791097 12750 sys_catalog.cc:455] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a70acf7fad5a4544b2751e2f778a7c8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a70acf7fad5a4544b2751e2f778a7c8b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 34607 } } }
I20260811 01:04:47.791818 12761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:04:47.791806 12750 sys_catalog.cc:458] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:47.793778 12780 mvcc.cc:205] Tried to move back new op lower bound from 7317136538800451584 to 7317136538789556224. Current Snapshot: MvccSnapshot[applied={T|T < 7317136538800451584}]
I20260811 01:04:47.794274 12761 catalog_manager.cc:1347] Generated new cluster ID: dec53663d526452eb0d679cbbd70844c
I20260811 01:04:47.794325 12761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 01:04:47 dist-test-slave-42z9 krb5kdc[12615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:04:47.802664 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:47.791315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56686 (local address 127.13.30.190:34607)
0811 01:04:47.791552 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:47.791568 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:47.791693 (+ 125us) server_negotiation.cc:407] Connection header received
0811 01:04:47.791912 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:47.791923 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:47.791999 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:47.792158 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:47.793113 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:47.794475 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:47.795308 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:47.795797 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:47.795904 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:47.798566 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:47.798572 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:47.798572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:47.798588 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:47.800542 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:47.800886 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:47.800890 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:47.800890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:47.801005 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:47.801263 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:47.801270 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:47.801270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:47.801792 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:47.802039 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:47.802211 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 01:04:47.802390 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":128,"threads_started":1}
I20260811 01:04:47.808840 12761 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:04:47.809374 12761 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:04:47.813973 12761 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b: Generated new TSK 0
I20260811 01:04:47.814231 12761 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.30.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
Entry for principal kudu/127.13.30.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab.
I20260811 01:04:47.846633 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34607
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:34855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:47.939450 12786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:47.939747 12786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:47.939779 12786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:47.941219 12786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:47.941277 12786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:47.941308 12786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:04:47.943195 12786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.129.keytab
--principal=kudu/127.13.30.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:47.943517 12786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:47.943827 12786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:47.949870 12800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:47.949872 12798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:47.949906 12802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:47.950495 12786 server_base.cc:1034] running on GCE node
I20260811 01:04:47.950790 12786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:47.951119 12786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:47.952308 12786 hybrid_clock.cc:648] HybridClock initialized: now 1786410287952276 us; error 43 us; skew 500 ppm
Aug 11 01:04:47 dist-test-slave-42z9 krb5kdc[12615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410287, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:47.955643 12786 init.cc:377] Logged in from keytab as kudu/127.13.30.129@KRBTEST.COM (short username kudu)
I20260811 01:04:47.956188 12786 webserver.cc:460] Webserver started at http://127.13.30.129:32939/ using document root <none> and password file <none>
I20260811 01:04:47.956455 12786 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:47.956511 12786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:47.956641 12786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:47.958218 12786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "7795b4e448a64500ae951132860f60ea"
format_stamp: "Formatted at 2026-08-11 01:04:47 on dist-test-slave-42z9"
server_key: "194878846a743e6309afca2cc04ac320"
server_key_iv: "4e8805008bcc158c477b24d3bae38c74"
server_key_version: "encryptionkey@0"
I20260811 01:04:47.958694 12786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "7795b4e448a64500ae951132860f60ea"
format_stamp: "Formatted at 2026-08-11 01:04:47 on dist-test-slave-42z9"
server_key: "194878846a743e6309afca2cc04ac320"
server_key_iv: "4e8805008bcc158c477b24d3bae38c74"
server_key_version: "encryptionkey@0"
I20260811 01:04:47.960551 12786 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 01:04:47.961613 12810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:47.961795 12786 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:47.961896 12786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "7795b4e448a64500ae951132860f60ea"
format_stamp: "Formatted at 2026-08-11 01:04:47 on dist-test-slave-42z9"
server_key: "194878846a743e6309afca2cc04ac320"
server_key_iv: "4e8805008bcc158c477b24d3bae38c74"
server_key_version: "encryptionkey@0"
I20260811 01:04:47.961985 12786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:47.980247 12786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:47.982918 12786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:47.983076 12786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:47.983326 12786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:47.983664 12786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:47.983698 12786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:47.983727 12786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:47.983753 12786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:47.989655 12786 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:32827
I20260811 01:04:47.989732 12998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:32827 every 8 connection(s)
I20260811 01:04:47.990046 12786 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:04:47.993126 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 12786
I20260811 01:04:47.993422 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:04:47.993781 13434 external_mini_cluster.cc:1428] Setting key 336252ae405e14492385e006ea60e90a
Aug 11 01:04:47 dist-test-slave-42z9 krb5kdc[12615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410287, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.129@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:04:48.000339 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:47.990805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:37207 (local address 127.13.30.190:34607)
0811 01:04:47.990857 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:47.990859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:47.991112 (+ 253us) server_negotiation.cc:407] Connection header received
0811 01:04:47.991686 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:47.991687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:47.991706 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:47.991759 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:47.992835 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:47.993397 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:47.994600 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:47.994820 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:47.994876 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:47.997221 (+ 2345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:47.997223 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:47.997223 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:47.997232 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:47.998665 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:47.999134 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:47.999135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:47.999136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:47.999220 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:47.999489 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:47.999490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:47.999491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:47.999657 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:47.999729 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:48.000003 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 01:04:48.000235 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 01:04:48.000370 13004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:47.990797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:34607 (local address 127.13.30.129:37207)
0811 01:04:47.990976 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:47.991028 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:47.991575 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:47.991838 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:47.991843 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:47.992494 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:47.992719 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:47.992725 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:47.993552 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:47.993553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:47.994513 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:47.994516 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:47.994898 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:47.994899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:47.995022 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:47.995561 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:04:47.995570 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:47.997117 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:47.998778 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:47.998786 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:47.998788 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:47.999027 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:47.999313 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:47.999314 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:47.999314 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:47.999428 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:47.999733 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:47.999740 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:47.999872 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 01:04:47.999958 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 01:04:48.000142 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
I20260811 01:04:48.000932 12999 heartbeater.cc:347] Connected to a master server at 127.13.30.190:34607
I20260811 01:04:48.001071 12999 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:48.001312 12999 heartbeater.cc:511] Master 127.13.30.190:34607 requested a full tablet report, sending...
I20260811 01:04:48.001930 12692 ts_manager.cc:194] Registered new tserver with Master: 7795b4e448a64500ae951132860f60ea (127.13.30.129:32827)
I20260811 01:04:48.002555 12692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.129@KRBTEST.COM'} at 127.13.30.129:37207
WARNING: no policy specified for kudu/127.13.30.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
Entry for principal kudu/127.13.30.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab.
I20260811 01:04:48.024426 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34607
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:34855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:48.113077 13008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:48.113327 13008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:48.113363 13008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:48.114674 13008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:48.114741 13008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:48.114782 13008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:04:48.116446 13008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.130.keytab
--principal=kudu/127.13.30.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:48.116719 13008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:48.117002 13008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:48.122514 13017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:48.122519 13016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:48.122519 13019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:48.122550 13008 server_base.cc:1034] running on GCE node
I20260811 01:04:48.122990 13008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:48.123255 13008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:48.124431 13008 hybrid_clock.cc:648] HybridClock initialized: now 1786410288124414 us; error 39 us; skew 500 ppm
Aug 11 01:04:48 dist-test-slave-42z9 krb5kdc[12615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410288, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:48.127439 13008 init.cc:377] Logged in from keytab as kudu/127.13.30.130@KRBTEST.COM (short username kudu)
I20260811 01:04:48.127985 13008 webserver.cc:460] Webserver started at http://127.13.30.130:44995/ using document root <none> and password file <none>
I20260811 01:04:48.128206 13008 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:48.128257 13008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:48.128386 13008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:48.130107 13008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "3866d454a6b441abae9f173b3a87f99b"
format_stamp: "Formatted at 2026-08-11 01:04:48 on dist-test-slave-42z9"
server_key: "a9dd21220064d6485a8e47d26d4fe8bf"
server_key_iv: "6a206a43111018e13ebe436310387ae0"
server_key_version: "encryptionkey@0"
I20260811 01:04:48.130576 13008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "3866d454a6b441abae9f173b3a87f99b"
format_stamp: "Formatted at 2026-08-11 01:04:48 on dist-test-slave-42z9"
server_key: "a9dd21220064d6485a8e47d26d4fe8bf"
server_key_iv: "6a206a43111018e13ebe436310387ae0"
server_key_version: "encryptionkey@0"
I20260811 01:04:48.132722 13008 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 01:04:48.133885 13033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:48.134136 13008 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:48.134255 13008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "3866d454a6b441abae9f173b3a87f99b"
format_stamp: "Formatted at 2026-08-11 01:04:48 on dist-test-slave-42z9"
server_key: "a9dd21220064d6485a8e47d26d4fe8bf"
server_key_iv: "6a206a43111018e13ebe436310387ae0"
server_key_version: "encryptionkey@0"
I20260811 01:04:48.134409 13008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:48.151428 13008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:48.154575 13008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:48.154734 13008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:48.155018 13008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:48.155383 13008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:48.155423 13008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:48.155447 13008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:48.155459 13008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:48.162248 13008 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:37027
I20260811 01:04:48.162449 13209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:37027 every 8 connection(s)
I20260811 01:04:48.162689 13008 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
Aug 11 01:04:48 dist-test-slave-42z9 krb5kdc[12615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410288, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.130@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:04:48.172431 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 13008
I20260811 01:04:48.172554 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:04:48.172755 13434 external_mini_cluster.cc:1428] Setting key 83f70b082a4efc6270a46df84765c295
I20260811 01:04:48.173982 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.163776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:60831 (local address 127.13.30.190:34607)
0811 01:04:48.163839 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:48.163842 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:48.164007 (+ 165us) server_negotiation.cc:407] Connection header received
0811 01:04:48.164640 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:48.164642 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:48.164654 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:48.164719 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:48.165938 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.166539 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.167556 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.167743 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.167792 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.170971 (+ 3179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:48.170973 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:48.170973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:48.170982 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:48.172408 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:48.172908 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:48.172909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:48.172910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:48.172976 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:48.173246 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:48.173247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:48.173248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:48.173400 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:48.173499 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:48.173800 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 01:04:48.173893 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 01:04:48.174137 13214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.163637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:34607 (local address 127.13.30.130:60831)
0811 01:04:48.163819 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:48.163897 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:48.164541 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:48.164788 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:48.164791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:48.165566 (+ 775us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:48.165812 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.165818 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.166626 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.166627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.167478 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.167481 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.167804 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.167804 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.167905 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.168747 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:04:48.168762 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:48.170844 (+ 2082us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:48.172503 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:48.172514 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:48.172517 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:48.172809 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:48.173041 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:48.173042 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:48.173042 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:48.173175 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:48.173498 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:48.173506 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:48.173663 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 01:04:48.173759 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 01:04:48.173920 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":79,"threads_started":1}
I20260811 01:04:48.174655 13210 heartbeater.cc:347] Connected to a master server at 127.13.30.190:34607
I20260811 01:04:48.174758 13210 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:48.174955 13210 heartbeater.cc:511] Master 127.13.30.190:34607 requested a full tablet report, sending...
I20260811 01:04:48.175333 12692 ts_manager.cc:194] Registered new tserver with Master: 3866d454a6b441abae9f173b3a87f99b (127.13.30.130:37027)
I20260811 01:04:48.175709 12692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.130@KRBTEST.COM'} at 127.13.30.130:60831
WARNING: no policy specified for kudu/127.13.30.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
Entry for principal kudu/127.13.30.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab.
I20260811 01:04:48.205569 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34607
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:34855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:48.299888 13218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:48.300136 13218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:48.300172 13218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:48.301653 13218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:48.301715 13218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:48.301746 13218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:04:48.303510 13218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:34855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.131.keytab
--principal=kudu/127.13.30.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:34607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:48.303766 13218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:48.304001 13218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:48.309286 13232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:48.309294 13228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:48.309419 13218 server_base.cc:1034] running on GCE node
W20260811 01:04:48.309310 13226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:48.309775 13218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:48.310006 13218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:48.311184 13218 hybrid_clock.cc:648] HybridClock initialized: now 1786410288311161 us; error 37 us; skew 500 ppm
Aug 11 01:04:48 dist-test-slave-42z9 krb5kdc[12615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410288, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:48.314183 13218 init.cc:377] Logged in from keytab as kudu/127.13.30.131@KRBTEST.COM (short username kudu)
I20260811 01:04:48.315038 13218 webserver.cc:460] Webserver started at http://127.13.30.131:44697/ using document root <none> and password file <none>
I20260811 01:04:48.315351 13218 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:48.315414 13218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:48.315574 13218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:48.316833 13218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "24c0c737a4fa43e988481bdc4869f238"
format_stamp: "Formatted at 2026-08-11 01:04:48 on dist-test-slave-42z9"
server_key: "63b27cdf4a1ae1cf3d436752b13fad41"
server_key_iv: "c734f978943d2807425dcb0f17581b2e"
server_key_version: "encryptionkey@0"
I20260811 01:04:48.317212 13218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "24c0c737a4fa43e988481bdc4869f238"
format_stamp: "Formatted at 2026-08-11 01:04:48 on dist-test-slave-42z9"
server_key: "63b27cdf4a1ae1cf3d436752b13fad41"
server_key_iv: "c734f978943d2807425dcb0f17581b2e"
server_key_version: "encryptionkey@0"
I20260811 01:04:48.318688 13218 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260811 01:04:48.319535 13240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:48.319833 13218 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:48.319947 13218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "24c0c737a4fa43e988481bdc4869f238"
format_stamp: "Formatted at 2026-08-11 01:04:48 on dist-test-slave-42z9"
server_key: "63b27cdf4a1ae1cf3d436752b13fad41"
server_key_iv: "c734f978943d2807425dcb0f17581b2e"
server_key_version: "encryptionkey@0"
I20260811 01:04:48.320017 13218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:48.353829 13218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:48.356809 13218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:48.356981 13218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:48.357216 13218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:48.357582 13218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:48.357620 13218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:48.357651 13218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:48.357676 13218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:48.363461 13218 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:41207
I20260811 01:04:48.363513 13442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:41207 every 8 connection(s)
I20260811 01:04:48.363845 13218 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
Aug 11 01:04:48 dist-test-slave-42z9 krb5kdc[12615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410288, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.131@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:04:48.372789 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 13218
I20260811 01:04:48.372884 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:04:48.373056 13434 external_mini_cluster.cc:1428] Setting key 499856f56030cbe517694d789b15876b
I20260811 01:04:48.373267 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.364618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:53133 (local address 127.13.30.190:34607)
0811 01:04:48.364675 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:48.364677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:48.364907 (+ 230us) server_negotiation.cc:407] Connection header received
0811 01:04:48.365468 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:48.365469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:48.365484 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:48.365552 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:48.366603 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.367112 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.368115 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.368304 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.368360 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.370778 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:48.370779 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:48.370780 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:48.370787 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:48.371911 (+ 1124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:48.372290 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:48.372291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:48.372291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:48.372344 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:48.372568 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:48.372569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:48.372570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:48.372709 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:48.372781 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:48.373109 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 01:04:48.373197 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 01:04:48.373541 13448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.364622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:34607 (local address 127.13.30.131:53133)
0811 01:04:48.364785 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:48.364824 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:48.365333 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:48.365656 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:48.365660 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:48.366288 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:48.366503 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.366507 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.367200 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.367201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.368028 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.368031 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.368377 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.368378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.368517 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.369151 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:04:48.369160 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:48.370679 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:48.371996 (+ 1317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:48.372004 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:48.372006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:48.372222 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:48.372399 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:04:48.372400 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:04:48.372400 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:04:48.372511 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:04:48.372800 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:48.372807 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:48.372953 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 01:04:48.373067 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 01:04:48.373255 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260811 01:04:48.373965 13443 heartbeater.cc:347] Connected to a master server at 127.13.30.190:34607
I20260811 01:04:48.374059 13443 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:48.374243 13443 heartbeater.cc:511] Master 127.13.30.190:34607 requested a full tablet report, sending...
I20260811 01:04:48.374615 12691 ts_manager.cc:194] Registered new tserver with Master: 24c0c737a4fa43e988481bdc4869f238 (127.13.30.131:41207)
I20260811 01:04:48.374989 12691 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.30.131@KRBTEST.COM'} at 127.13.30.131:53133
I20260811 01:04:48.385298 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:04:48.394680 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.386775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56688 (local address 127.13.30.190:34607)
0811 01:04:48.386919 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:48.386922 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:48.387055 (+ 133us) server_negotiation.cc:407] Connection header received
0811 01:04:48.387146 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:48.387148 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:48.387162 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:48.387216 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:48.387996 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.388502 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.389232 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.389431 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.389541 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.391311 (+ 1770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:48.391313 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:48.391313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:48.391322 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:48.392948 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:48.393530 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:48.393532 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:48.393533 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:48.393627 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:48.393980 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:48.393982 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:48.393982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:48.394179 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:48.394292 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:48.394518 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 01:04:48.394605 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 01:04:48.397244 12691 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56688:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:04:48.399559 12691 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:04:48.406498 13460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.402201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:41207 (local address 127.0.0.1:49726)
0811 01:04:48.402715 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:48.402726 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:48.402790 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:48.403014 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:48.403017 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:48.403019 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:48.403105 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.403107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.404054 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.404055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.405266 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.405269 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.406160 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.406160 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.406242 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.406258 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 01:04:48.406337 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 01:04:48.406402 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":5,"thread_start_us":98,"threads_started":1}
I20260811 01:04:48.406499 13468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.402505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49726 (local address 127.13.30.131:41207)
0811 01:04:48.402701 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:48.402706 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:48.402816 (+ 110us) server_negotiation.cc:407] Connection header received
0811 01:04:48.402875 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:48.402877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:48.402893 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:48.403183 (+ 290us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:48.403258 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.403954 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.405357 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.406074 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.406149 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.406212 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:48.406360 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 01:04:48.406409 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":93,"threads_started":1}
I20260811 01:04:48.406651 13463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.402201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:37027 (local address 127.0.0.1:60970)
0811 01:04:48.402718 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:48.402728 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:48.402790 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:48.403069 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:48.403070 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:48.403072 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:48.403130 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.403132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.404489 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.404490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.405582 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.405584 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.406444 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.406445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.406499 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.406503 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:04:48.406551 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 01:04:48.406588 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"mutex_wait_us":6,"thread_start_us":95,"threads_started":1}
I20260811 01:04:48.406940 13467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.402427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60970 (local address 127.13.30.130:37027)
0811 01:04:48.402650 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:48.402656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:48.402791 (+ 135us) server_negotiation.cc:407] Connection header received
0811 01:04:48.402890 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:48.402892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:48.402909 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:48.402977 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:48.403210 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.404367 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.405687 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.406368 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.406442 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.406492 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:48.406561 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 01:04:48.406601 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":106,"threads_started":1}
I20260811 01:04:48.407538 13107 tablet_service.cc:1467] Processing CreateTablet for tablet 63637b1777084d12a84d5c8c88eedead (DEFAULT_TABLE table=test-table [id=a7181174eccb402a8b5b9f41d2fb5098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:48.407536 13318 tablet_service.cc:1467] Processing CreateTablet for tablet 63637b1777084d12a84d5c8c88eedead (DEFAULT_TABLE table=test-table [id=a7181174eccb402a8b5b9f41d2fb5098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:48.407745 13461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.402201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:32827 (local address 127.0.0.1:49682)
0811 01:04:48.402642 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:48.402689 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:48.402760 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:48.403126 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:48.403127 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:48.403129 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:48.403160 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.403161 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.405500 (+ 2339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.405501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.406276 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.406278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.407532 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.407532 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.407598 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.407603 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:04:48.407649 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:04:48.407693 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":62,"threads_started":1}
I20260811 01:04:48.407939 13107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63637b1777084d12a84d5c8c88eedead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:48.407939 13318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63637b1777084d12a84d5c8c88eedead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:48.407984 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.402524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49682 (local address 127.13.30.129:32827)
0811 01:04:48.402907 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:48.402911 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:48.402920 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:04:48.402957 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:48.402959 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:48.402974 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:48.403054 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:48.403230 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.404367 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.406657 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.407382 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.407442 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.407498 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:48.407863 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 01:04:48.407918 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":92,"threads_started":1}
I20260811 01:04:48.408537 12895 tablet_service.cc:1467] Processing CreateTablet for tablet 63637b1777084d12a84d5c8c88eedead (DEFAULT_TABLE table=test-table [id=a7181174eccb402a8b5b9f41d2fb5098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:48.408798 12895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63637b1777084d12a84d5c8c88eedead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:48.411752 13475 tablet_bootstrap.cc:492] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea: Bootstrap starting.
I20260811 01:04:48.412366 13475 tablet_bootstrap.cc:654] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:48.412631 13481 tablet_bootstrap.cc:492] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238: Bootstrap starting.
I20260811 01:04:48.413276 13475 log.cc:824] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:48.413409 13481 tablet_bootstrap.cc:654] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:48.413745 13480 tablet_bootstrap.cc:492] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b: Bootstrap starting.
I20260811 01:04:48.414041 13481 log.cc:824] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:48.414609 13475 tablet_bootstrap.cc:492] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea: No bootstrap required, opened a new log
I20260811 01:04:48.414698 13475 ts_tablet_manager.cc:1397] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260811 01:04:48.414808 13480 tablet_bootstrap.cc:654] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:48.414887 13481 tablet_bootstrap.cc:492] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238: No bootstrap required, opened a new log
I20260811 01:04:48.414953 13481 ts_tablet_manager.cc:1397] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 01:04:48.415534 13480 log.cc:824] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:48.416672 13480 tablet_bootstrap.cc:492] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b: No bootstrap required, opened a new log
I20260811 01:04:48.416752 13480 ts_tablet_manager.cc:1397] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 01:04:48.416778 13475 raft_consensus.cc:348] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3866d454a6b441abae9f173b3a87f99b" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37027 } } peers { permanent_uuid: "24c0c737a4fa43e988481bdc4869f238" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41207 } } peers { permanent_uuid: "7795b4e448a64500ae951132860f60ea" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32827 } }
I20260811 01:04:48.416985 13475 raft_consensus.cc:374] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:48.417032 13475 raft_consensus.cc:729] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7795b4e448a64500ae951132860f60ea, State: Initialized, Role: FOLLOWER
I20260811 01:04:48.416949 13481 raft_consensus.cc:348] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3866d454a6b441abae9f173b3a87f99b" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37027 } } peers { permanent_uuid: "24c0c737a4fa43e988481bdc4869f238" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41207 } } peers { permanent_uuid: "7795b4e448a64500ae951132860f60ea" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32827 } }
I20260811 01:04:48.417115 13481 raft_consensus.cc:374] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:48.417153 13481 raft_consensus.cc:729] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24c0c737a4fa43e988481bdc4869f238, State: Initialized, Role: FOLLOWER
I20260811 01:04:48.417187 13475 consensus_queue.cc:260] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3866d454a6b441abae9f173b3a87f99b" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37027 } } peers { permanent_uuid: "24c0c737a4fa43e988481bdc4869f238" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41207 } } peers { permanent_uuid: "7795b4e448a64500ae951132860f60ea" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32827 } }
I20260811 01:04:48.417254 13481 consensus_queue.cc:260] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3866d454a6b441abae9f173b3a87f99b" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37027 } } peers { permanent_uuid: "24c0c737a4fa43e988481bdc4869f238" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41207 } } peers { permanent_uuid: "7795b4e448a64500ae951132860f60ea" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32827 } }
I20260811 01:04:48.417547 13481 ts_tablet_manager.cc:1428] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 01:04:48.417547 13475 ts_tablet_manager.cc:1428] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 01:04:48.417682 13443 heartbeater.cc:503] Master 127.13.30.190:34607 was elected leader, sending a full tablet report...
I20260811 01:04:48.417995 12999 heartbeater.cc:503] Master 127.13.30.190:34607 was elected leader, sending a full tablet report...
I20260811 01:04:48.418804 13480 raft_consensus.cc:348] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3866d454a6b441abae9f173b3a87f99b" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37027 } } peers { permanent_uuid: "24c0c737a4fa43e988481bdc4869f238" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41207 } } peers { permanent_uuid: "7795b4e448a64500ae951132860f60ea" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32827 } }
I20260811 01:04:48.418983 13480 raft_consensus.cc:374] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:48.419031 13480 raft_consensus.cc:729] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3866d454a6b441abae9f173b3a87f99b, State: Initialized, Role: FOLLOWER
I20260811 01:04:48.419149 13480 consensus_queue.cc:260] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3866d454a6b441abae9f173b3a87f99b" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37027 } } peers { permanent_uuid: "24c0c737a4fa43e988481bdc4869f238" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41207 } } peers { permanent_uuid: "7795b4e448a64500ae951132860f60ea" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32827 } }
I20260811 01:04:48.419445 13480 ts_tablet_manager.cc:1428] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:04:48.419497 13210 heartbeater.cc:503] Master 127.13.30.190:34607 was elected leader, sending a full tablet report...
W20260811 01:04:48.490828 13003 tablet.cc:2369] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:04:48.507977 13488 raft_consensus.cc:482] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:04:48.508252 13488 raft_consensus.cc:504] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3866d454a6b441abae9f173b3a87f99b" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37027 } } peers { permanent_uuid: "24c0c737a4fa43e988481bdc4869f238" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41207 } } peers { permanent_uuid: "7795b4e448a64500ae951132860f60ea" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32827 } }
I20260811 01:04:48.508826 13488 leader_election.cc:288] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3866d454a6b441abae9f173b3a87f99b (127.13.30.130:37027), 7795b4e448a64500ae951132860f60ea (127.13.30.129:32827)
I20260811 01:04:48.511884 13467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.509216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:34757 (local address 127.13.30.130:37027)
0811 01:04:48.509270 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:48.509272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:48.509285 (+ 13us) server_negotiation.cc:407] Connection header received
0811 01:04:48.509321 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:48.509322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:48.509330 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:48.509406 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:48.509620 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.510117 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.511131 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.511534 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.511603 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.511613 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:48.511757 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 01:04:48.511799 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 01:04:48.511884 13448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.509063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:37027 (local address 127.13.30.131:34757)
0811 01:04:48.509130 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:48.509150 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:48.509228 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:48.509462 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:48.509464 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:48.509467 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:48.509550 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.509552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.510197 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.510199 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.511034 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.511037 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.511612 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.511613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.511694 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.511698 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:04:48.511745 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 01:04:48.511799 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 01:04:48.512259 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.509226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:45891 (local address 127.13.30.129:32827)
0811 01:04:48.509270 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:48.509272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:48.509492 (+ 220us) server_negotiation.cc:407] Connection header received
0811 01:04:48.509580 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:48.509582 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:48.509595 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:48.509654 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:48.509837 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.510383 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.511418 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.511828 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.511909 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.511922 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:48.512108 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 01:04:48.512168 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 01:04:48.512557 13490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.509169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:32827 (local address 127.13.30.131:45891)
0811 01:04:48.509386 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:48.509395 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:48.509484 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:48.509663 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:48.509664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:48.509667 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:48.509769 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.509771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.510473 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.510474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.511302 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.511305 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.511913 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.511914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.511998 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.512004 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 01:04:48.512398 (+ 394us) client_negotiation.cc:240] Negotiation successful
0811 01:04:48.512456 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":165,"threads_started":1}
I20260811 01:04:48.512471 13140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63637b1777084d12a84d5c8c88eedead" candidate_uuid: "24c0c737a4fa43e988481bdc4869f238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3866d454a6b441abae9f173b3a87f99b" is_pre_election: true
I20260811 01:04:48.512703 13140 raft_consensus.cc:2454] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24c0c737a4fa43e988481bdc4869f238 in term 0.
I20260811 01:04:48.513023 13242 leader_election.cc:302] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24c0c737a4fa43e988481bdc4869f238, 3866d454a6b441abae9f173b3a87f99b; no voters:
I20260811 01:04:48.513063 12928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63637b1777084d12a84d5c8c88eedead" candidate_uuid: "24c0c737a4fa43e988481bdc4869f238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7795b4e448a64500ae951132860f60ea" is_pre_election: true
I20260811 01:04:48.513226 13488 raft_consensus.cc:2781] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:04:48.513255 12928 raft_consensus.cc:2454] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24c0c737a4fa43e988481bdc4869f238 in term 0.
I20260811 01:04:48.513283 13488 raft_consensus.cc:482] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:04:48.513314 13488 raft_consensus.cc:3037] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:48.514206 13488 raft_consensus.cc:504] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3866d454a6b441abae9f173b3a87f99b" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37027 } } peers { permanent_uuid: "24c0c737a4fa43e988481bdc4869f238" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41207 } } peers { permanent_uuid: "7795b4e448a64500ae951132860f60ea" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32827 } }
I20260811 01:04:48.514355 13488 leader_election.cc:288] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [CANDIDATE]: Term 1 election: Requested vote from peers 3866d454a6b441abae9f173b3a87f99b (127.13.30.130:37027), 7795b4e448a64500ae951132860f60ea (127.13.30.129:32827)
I20260811 01:04:48.514565 13140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63637b1777084d12a84d5c8c88eedead" candidate_uuid: "24c0c737a4fa43e988481bdc4869f238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3866d454a6b441abae9f173b3a87f99b"
I20260811 01:04:48.514612 12928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63637b1777084d12a84d5c8c88eedead" candidate_uuid: "24c0c737a4fa43e988481bdc4869f238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7795b4e448a64500ae951132860f60ea"
I20260811 01:04:48.514683 12928 raft_consensus.cc:3037] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:48.514688 13140 raft_consensus.cc:3037] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:48.515488 12928 raft_consensus.cc:2454] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24c0c737a4fa43e988481bdc4869f238 in term 1.
I20260811 01:04:48.515547 13140 raft_consensus.cc:2454] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24c0c737a4fa43e988481bdc4869f238 in term 1.
I20260811 01:04:48.515719 13243 leader_election.cc:302] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24c0c737a4fa43e988481bdc4869f238, 7795b4e448a64500ae951132860f60ea; no voters:
I20260811 01:04:48.515882 13488 raft_consensus.cc:2781] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:48.516062 13488 raft_consensus.cc:686] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [term 1 LEADER]: Becoming Leader. State: Replica: 24c0c737a4fa43e988481bdc4869f238, State: Running, Role: LEADER
I20260811 01:04:48.516162 13488 consensus_queue.cc:237] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3866d454a6b441abae9f173b3a87f99b" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37027 } } peers { permanent_uuid: "24c0c737a4fa43e988481bdc4869f238" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41207 } } peers { permanent_uuid: "7795b4e448a64500ae951132860f60ea" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32827 } }
I20260811 01:04:48.517055 12690 catalog_manager.cc:5495] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24c0c737a4fa43e988481bdc4869f238 (127.13.30.131). New cstate: current_term: 1 leader_uuid: "24c0c737a4fa43e988481bdc4869f238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3866d454a6b441abae9f173b3a87f99b" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24c0c737a4fa43e988481bdc4869f238" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 41207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7795b4e448a64500ae951132860f60ea" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32827 } health_report { overall_health: UNKNOWN } } }
I20260811 01:04:48.522250 13468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.519881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49730 (local address 127.13.30.131:41207)
0811 01:04:48.519950 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:48.519952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:48.519960 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:04:48.520000 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:48.520001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:48.520022 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:48.520093 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:04:48.520219 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.520716 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.521514 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.521724 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.521779 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.521923 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:04:48.522033 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:04:48.522107 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:48.522143 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 01:04:48.522166 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 01:04:48.524219 12928 raft_consensus.cc:1261] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea [term 1 FOLLOWER]: Refusing update from remote peer 24c0c737a4fa43e988481bdc4869f238: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:04:48.524217 13140 raft_consensus.cc:1261] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b [term 1 FOLLOWER]: Refusing update from remote peer 24c0c737a4fa43e988481bdc4869f238: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:04:48.524634 13491 consensus_queue.cc:1035] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7795b4e448a64500ae951132860f60ea" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:04:48.524770 13488 consensus_queue.cc:1035] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3866d454a6b441abae9f173b3a87f99b" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:04:48.527330 13496 mvcc.cc:205] Tried to move back new op lower bound from 7317136541792366592 to 7317136541762875392. Current Snapshot: MvccSnapshot[applied={T|T < 7317136541792366592}]
I20260811 01:04:48.527436 13497 mvcc.cc:205] Tried to move back new op lower bound from 7317136541792366592 to 7317136541762875392. Current Snapshot: MvccSnapshot[applied={T|T < 7317136541792366592}]
I20260811 01:04:48.529917 12691 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56688:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:04:48.530018 12691 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56688:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:04:48.530886 12691 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a70acf7fad5a4544b2751e2f778a7c8b: Sending DeleteTablet for 3 replicas of tablet 63637b1777084d12a84d5c8c88eedead
I20260811 01:04:48.531247 12895 tablet_service.cc:1514] Processing DeleteTablet for tablet 63637b1777084d12a84d5c8c88eedead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:48 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:49682
I20260811 01:04:48.531322 13107 tablet_service.cc:1514] Processing DeleteTablet for tablet 63637b1777084d12a84d5c8c88eedead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:48 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:60970
I20260811 01:04:48.531418 13318 tablet_service.cc:1514] Processing DeleteTablet for tablet 63637b1777084d12a84d5c8c88eedead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:48 UTC) from {username='kudu', principal='kudu/127.13.30.190@KRBTEST.COM'} at 127.0.0.1:49726
I20260811 01:04:48.531647 13510 tablet_replica.cc:330] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea: stopping tablet replica
I20260811 01:04:48.531749 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 12786
I20260811 01:04:48.531770 13510 raft_consensus.cc:2229] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:48.531891 13510 raft_consensus.cc:2258] T 63637b1777084d12a84d5c8c88eedead P 7795b4e448a64500ae951132860f60ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:48.545648 13511 tablet_replica.cc:330] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b: stopping tablet replica
I20260811 01:04:48.545847 13511 raft_consensus.cc:2229] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:48.546005 13511 raft_consensus.cc:2258] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:48.546207 13512 tablet_replica.cc:330] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238: stopping tablet replica
I20260811 01:04:48.546317 13512 raft_consensus.cc:2229] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:04:48.546435 13512 raft_consensus.cc:2258] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:48.547897 13512 ts_tablet_manager.cc:1905] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:48.547935 13511 ts_tablet_manager.cc:1905] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:48.549697 13512 ts_tablet_manager.cc:1918] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:48.549738 13511 ts_tablet_manager.cc:1918] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:48.549825 13511 log.cc:1196] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/63637b1777084d12a84d5c8c88eedead
I20260811 01:04:48.549937 13512 log.cc:1196] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/63637b1777084d12a84d5c8c88eedead
I20260811 01:04:48.550161 13511 ts_tablet_manager.cc:1939] T 63637b1777084d12a84d5c8c88eedead P 3866d454a6b441abae9f173b3a87f99b: Deleting consensus metadata
I20260811 01:04:48.550362 13512 ts_tablet_manager.cc:1939] T 63637b1777084d12a84d5c8c88eedead P 24c0c737a4fa43e988481bdc4869f238: Deleting consensus metadata
I20260811 01:04:48.550700 12664 catalog_manager.cc:4841] TS 3866d454a6b441abae9f173b3a87f99b (127.13.30.130:37027): tablet 63637b1777084d12a84d5c8c88eedead (table test-table [id=a7181174eccb402a8b5b9f41d2fb5098]) successfully deleted
I20260811 01:04:48.550874 12668 catalog_manager.cc:4841] TS 24c0c737a4fa43e988481bdc4869f238 (127.13.30.131:41207): tablet 63637b1777084d12a84d5c8c88eedead (table test-table [id=a7181174eccb402a8b5b9f41d2fb5098]) successfully deleted
W20260811 01:04:48.553074 12665 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:32827 (error 108)
I20260811 01:04:48.553668 13460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.553533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:32827 (local address 127.0.0.1:49698)
0811 01:04:48.553591 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:48.553631 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:32827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 01:04:48.553776 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 13008
W20260811 01:04:48.575147 12665 catalog_manager.cc:4584] TS 7795b4e448a64500ae951132860f60ea (127.13.30.129:32827): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 63637b1777084d12a84d5c8c88eedead: Network error: Client connection negotiation failed: client connection to 127.13.30.129:32827: connect: Connection refused (error 111)
I20260811 01:04:48.584581 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 13218
I20260811 01:04:48.605655 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 12634
2026-08-11T01:04:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2294 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T01:04:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:04:48Z Disabled control of system clock
I20260811 01:04:48.648885 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:35931
--webserver_interface=127.13.30.190
--webserver_port=0
--builtin_ntp_servers=127.13.30.148:43971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:35931
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:04:48.734731 13521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:48.734984 13521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:48.735005 13521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:48.736203 13521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:04:48.736246 13521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:48.736258 13521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:48.736270 13521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:04:48.736280 13521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:04:48.737793 13521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:43971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:35931
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:35931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:48.738052 13521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:48.738344 13521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:48.743557 13537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:48.743533 13532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:48.743523 13530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:48.743927 13521 server_base.cc:1034] running on GCE node
I20260811 01:04:48.744185 13521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:48.744499 13521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:48.745646 13521 hybrid_clock.cc:648] HybridClock initialized: now 1786410288745630 us; error 32 us; skew 500 ppm
I20260811 01:04:48.747102 13521 webserver.cc:460] Webserver started at http://127.13.30.190:41097/ using document root <none> and password file <none>
I20260811 01:04:48.747368 13521 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:48.747421 13521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:48.747553 13521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:48.748700 13521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "95336f41406e44e2839702118a9c64bc"
format_stamp: "Formatted at 2026-08-11 01:04:48 on dist-test-slave-42z9"
server_key: "78ca519a4aaa16e43037414f9cb75eb5"
server_key_iv: "7f403c79d9e7a6198a8636a728e9cd64"
server_key_version: "encryptionkey@0"
I20260811 01:04:48.749058 13521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "95336f41406e44e2839702118a9c64bc"
format_stamp: "Formatted at 2026-08-11 01:04:48 on dist-test-slave-42z9"
server_key: "78ca519a4aaa16e43037414f9cb75eb5"
server_key_iv: "7f403c79d9e7a6198a8636a728e9cd64"
server_key_version: "encryptionkey@0"
I20260811 01:04:48.750653 13521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:04:48.751919 13547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:48.752192 13521 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:48.752327 13521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "95336f41406e44e2839702118a9c64bc"
format_stamp: "Formatted at 2026-08-11 01:04:48 on dist-test-slave-42z9"
server_key: "78ca519a4aaa16e43037414f9cb75eb5"
server_key_iv: "7f403c79d9e7a6198a8636a728e9cd64"
server_key_version: "encryptionkey@0"
I20260811 01:04:48.752424 13521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:48.774775 13521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:48.775174 13521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:48.775321 13521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:48.780241 13521 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:35931
I20260811 01:04:48.780282 13633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:35931 every 8 connection(s)
I20260811 01:04:48.780656 13521 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:04:48.781747 13634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:48.784324 13634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc: Bootstrap starting.
I20260811 01:04:48.784363 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 13521
I20260811 01:04:48.784453 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:04:48.784659 13434 external_mini_cluster.cc:1428] Setting key 52e07bb060803cce1a1d6b65b69d749f
I20260811 01:04:48.785077 13634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:48.785476 13634 log.cc:824] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:48.786314 13634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc: No bootstrap required, opened a new log
I20260811 01:04:48.788712 13634 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95336f41406e44e2839702118a9c64bc" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35931 } }
I20260811 01:04:48.788872 13634 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:48.788894 13634 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95336f41406e44e2839702118a9c64bc, State: Initialized, Role: FOLLOWER
I20260811 01:04:48.789019 13634 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95336f41406e44e2839702118a9c64bc" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35931 } }
I20260811 01:04:48.789103 13634 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:04:48.789143 13634 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:04:48.789186 13634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:48.789896 13634 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95336f41406e44e2839702118a9c64bc" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35931 } }
I20260811 01:04:48.790012 13634 leader_election.cc:302] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95336f41406e44e2839702118a9c64bc; no voters:
I20260811 01:04:48.790211 13634 leader_election.cc:288] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:04:48.790309 13645 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:48.790508 13645 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [term 1 LEADER]: Becoming Leader. State: Replica: 95336f41406e44e2839702118a9c64bc, State: Running, Role: LEADER
I20260811 01:04:48.790635 13645 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95336f41406e44e2839702118a9c64bc" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35931 } }
I20260811 01:04:48.790984 13634 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:04:48.791836 13652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95336f41406e44e2839702118a9c64bc. Latest consensus state: current_term: 1 leader_uuid: "95336f41406e44e2839702118a9c64bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95336f41406e44e2839702118a9c64bc" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35931 } } }
I20260811 01:04:48.791853 13649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95336f41406e44e2839702118a9c64bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95336f41406e44e2839702118a9c64bc" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 35931 } } }
I20260811 01:04:48.791999 13652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:48.792001 13649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:48.792234 13638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.785205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40212 (local address 127.13.30.190:35931)
0811 01:04:48.785475 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:48.785484 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:48.785520 (+ 36us) server_negotiation.cc:407] Connection header received
0811 01:04:48.786049 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:48.786058 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:48.786140 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:48.786295 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:48.786686 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.788088 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.789287 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.789953 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.790149 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.790999 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:48.791004 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:48.791004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:48.791287 (+ 283us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:48.791337 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:48.791356 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:48.791445 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:48.791866 (+ 421us) server_negotiation.cc:299] Negotiation successful
0811 01:04:48.791976 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":96,"threads_started":1}
I20260811 01:04:48.792542 13667 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:04:48.793264 13667 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:04:48.795212 13667 catalog_manager.cc:1347] Generated new cluster ID: ffcaf2db41f64d0aaf825e85c176209d
I20260811 01:04:48.795277 13667 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:04:48.804998 13667 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:04:48.805579 13667 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:04:48.809132 13667 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc: Generated new TSK 0
I20260811 01:04:48.809343 13667 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:04:48.813016 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.129:0
--local_ip_for_outbound_sockets=127.13.30.129
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35931
--builtin_ntp_servers=127.13.30.148:43971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:04:48.900605 13686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:48.900823 13686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:48.900846 13686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:48.902242 13686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:48.902292 13686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:48.902319 13686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.129
I20260811 01:04:48.903949 13686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:43971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.30.129
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.129
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:48.904213 13686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:48.904531 13686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:48.909765 13696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:48.909950 13686 server_base.cc:1034] running on GCE node
W20260811 01:04:48.909767 13697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:48.909767 13701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:48.910288 13686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:48.910533 13686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:48.911695 13686 hybrid_clock.cc:648] HybridClock initialized: now 1786410288911681 us; error 32 us; skew 500 ppm
I20260811 01:04:48.913090 13686 webserver.cc:460] Webserver started at http://127.13.30.129:39971/ using document root <none> and password file <none>
I20260811 01:04:48.913329 13686 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:48.913383 13686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:48.913553 13686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:48.914687 13686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/data/instance:
uuid: "5e23f2111d574fbf857c6dd19879c2a4"
format_stamp: "Formatted at 2026-08-11 01:04:48 on dist-test-slave-42z9"
server_key: "750905f9d10c7b61df902ed3b5697df6"
server_key_iv: "77452ee828bbc49be915364da3d48b2c"
server_key_version: "encryptionkey@0"
I20260811 01:04:48.915045 13686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance:
uuid: "5e23f2111d574fbf857c6dd19879c2a4"
format_stamp: "Formatted at 2026-08-11 01:04:48 on dist-test-slave-42z9"
server_key: "750905f9d10c7b61df902ed3b5697df6"
server_key_iv: "77452ee828bbc49be915364da3d48b2c"
server_key_version: "encryptionkey@0"
I20260811 01:04:48.916376 13686 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:04:48.917129 13714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:48.917303 13686 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:48.917393 13686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/wal
uuid: "5e23f2111d574fbf857c6dd19879c2a4"
format_stamp: "Formatted at 2026-08-11 01:04:48 on dist-test-slave-42z9"
server_key: "750905f9d10c7b61df902ed3b5697df6"
server_key_iv: "77452ee828bbc49be915364da3d48b2c"
server_key_version: "encryptionkey@0"
I20260811 01:04:48.917505 13686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:48.930349 13686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:48.930698 13686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:48.930847 13686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:48.931093 13686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:48.931442 13686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:48.931479 13686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:48.931510 13686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:48.931535 13686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:48.938872 13686 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.129:33959
I20260811 01:04:48.938941 13895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.129:33959 every 8 connection(s)
I20260811 01:04:48.939426 13686 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/data/info.pb
I20260811 01:04:48.945269 13638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.940342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.129:53421 (local address 127.13.30.190:35931)
0811 01:04:48.940403 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:48.940405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:48.940734 (+ 329us) server_negotiation.cc:407] Connection header received
0811 01:04:48.941311 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:48.941312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:48.941326 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:48.941387 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:48.942119 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.942640 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.943630 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.943845 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.943900 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.944984 (+ 1084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:48.944991 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:48.944991 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:48.944997 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:48.945012 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:48.945016 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:48.945058 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:48.945146 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 01:04:48.945176 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 01:04:48.945583 13904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:48.940372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35931 (local address 127.13.30.129:53421)
0811 01:04:48.940587 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:48.940628 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:48.941205 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:48.941475 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:48.941480 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:48.941491 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:48.942028 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.942034 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.942730 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.942731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.943544 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:48.943547 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:48.943927 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:48.943929 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:48.944056 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:48.944669 (+ 613us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:04:48.944670 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:48.944712 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:04:48.944829 (+ 117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:48.945073 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:48.945079 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:48.945083 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:04:48.945145 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 01:04:48.945271 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":89,"threads_started":1}
I20260811 01:04:48.946113 13896 heartbeater.cc:347] Connected to a master server at 127.13.30.190:35931
I20260811 01:04:48.946209 13896 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:48.946417 13896 heartbeater.cc:511] Master 127.13.30.190:35931 requested a full tablet report, sending...
I20260811 01:04:48.946972 13574 ts_manager.cc:194] Registered new tserver with Master: 5e23f2111d574fbf857c6dd19879c2a4 (127.13.30.129:33959)
I20260811 01:04:48.947641 13574 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.30.129:53421
I20260811 01:04:48.949659 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 13686
I20260811 01:04:48.949752 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-0/wal/instance
I20260811 01:04:48.949910 13434 external_mini_cluster.cc:1428] Setting key 5f232fd3fb26514bf5ba04f99f4357dc
I20260811 01:04:48.950771 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.130:0
--local_ip_for_outbound_sockets=127.13.30.130
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35931
--builtin_ntp_servers=127.13.30.148:43971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:04:49.040086 13905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:49.040331 13905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:49.040355 13905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:49.041630 13905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:49.041679 13905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:49.041706 13905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.130
I20260811 01:04:49.043203 13905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:43971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.30.130
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.130
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:49.043455 13905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:49.043772 13905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:49.049542 13915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:49.049455 13916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:49.049751 13919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:49.049810 13905 server_base.cc:1034] running on GCE node
I20260811 01:04:49.050232 13905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:49.050522 13905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:49.051690 13905 hybrid_clock.cc:648] HybridClock initialized: now 1786410289051699 us; error 106 us; skew 500 ppm
I20260811 01:04:49.053148 13905 webserver.cc:460] Webserver started at http://127.13.30.130:34283/ using document root <none> and password file <none>
I20260811 01:04:49.053429 13905 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:49.053519 13905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:49.053658 13905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:49.054797 13905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/data/instance:
uuid: "baf9341f0a8e4137a0c1f6a41d969059"
format_stamp: "Formatted at 2026-08-11 01:04:49 on dist-test-slave-42z9"
server_key: "cda35ee0a5edeaef8ec86d0ab8297c7b"
server_key_iv: "2eda21bf1ed6f87f3ff4acd711a508cd"
server_key_version: "encryptionkey@0"
I20260811 01:04:49.055150 13905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance:
uuid: "baf9341f0a8e4137a0c1f6a41d969059"
format_stamp: "Formatted at 2026-08-11 01:04:49 on dist-test-slave-42z9"
server_key: "cda35ee0a5edeaef8ec86d0ab8297c7b"
server_key_iv: "2eda21bf1ed6f87f3ff4acd711a508cd"
server_key_version: "encryptionkey@0"
I20260811 01:04:49.056614 13905 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:04:49.057351 13930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:49.057529 13905 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:49.057610 13905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/wal
uuid: "baf9341f0a8e4137a0c1f6a41d969059"
format_stamp: "Formatted at 2026-08-11 01:04:49 on dist-test-slave-42z9"
server_key: "cda35ee0a5edeaef8ec86d0ab8297c7b"
server_key_iv: "2eda21bf1ed6f87f3ff4acd711a508cd"
server_key_version: "encryptionkey@0"
I20260811 01:04:49.057682 13905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:49.071509 13905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:49.071846 13905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:49.071986 13905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:49.072238 13905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:49.072608 13905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:49.072645 13905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:49.072675 13905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:49.072692 13905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:49.078641 13905 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.130:37681
I20260811 01:04:49.078686 14127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.130:37681 every 8 connection(s)
I20260811 01:04:49.079049 13905 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/data/info.pb
I20260811 01:04:49.084714 13638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.079805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:49313 (local address 127.13.30.190:35931)
0811 01:04:49.079876 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:49.079878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:49.080080 (+ 202us) server_negotiation.cc:407] Connection header received
0811 01:04:49.080575 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:49.080576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:49.080587 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:49.080645 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:49.081574 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.082261 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.083302 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.083518 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.083577 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.084470 (+ 893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:49.084471 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:49.084472 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:49.084477 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:49.084493 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:49.084497 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:49.084545 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:49.084618 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 01:04:49.084647 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 01:04:49.084911 14132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.079765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35931 (local address 127.13.30.130:49313)
0811 01:04:49.079959 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:49.079995 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:49.080484 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:49.080782 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:49.080786 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:49.080796 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:49.081323 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:49.081327 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.082376 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.082377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:49.083217 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:49.083220 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.083590 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.083591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:49.083705 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.084301 (+ 596us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:04:49.084302 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:49.084333 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:04:49.084359 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:49.084557 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:49.084560 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:49.084563 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:04:49.084609 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:04:49.084700 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":84,"threads_started":1}
I20260811 01:04:49.085366 14130 heartbeater.cc:347] Connected to a master server at 127.13.30.190:35931
I20260811 01:04:49.085485 14130 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:49.085675 14130 heartbeater.cc:511] Master 127.13.30.190:35931 requested a full tablet report, sending...
I20260811 01:04:49.086030 13574 ts_manager.cc:194] Registered new tserver with Master: baf9341f0a8e4137a0c1f6a41d969059 (127.13.30.130:37681)
I20260811 01:04:49.086377 13574 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.30.130:49313
I20260811 01:04:49.087380 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 13905
I20260811 01:04:49.087476 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/wal/instance
I20260811 01:04:49.087646 13434 external_mini_cluster.cc:1428] Setting key e78974ca8fc7c0c5a4e2472092035651
I20260811 01:04:49.088526 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.30.131:0
--local_ip_for_outbound_sockets=127.13.30.131
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35931
--builtin_ntp_servers=127.13.30.148:43971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:04:49.177466 14134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:49.177734 14134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:49.177757 14134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:49.179006 14134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:49.179060 14134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:49.179087 14134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.30.131
I20260811 01:04:49.180543 14134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:43971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.30.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.30.131
--webserver_port=0
--tserver_master_addrs=127.13.30.190:35931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.30.131
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:49.180810 14134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:49.181125 14134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:49.186592 14139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:49.186619 14134 server_base.cc:1034] running on GCE node
W20260811 01:04:49.186563 14145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:49.186583 14140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:49.186971 14134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:49.187217 14134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:49.188370 14134 hybrid_clock.cc:648] HybridClock initialized: now 1786410289188355 us; error 30 us; skew 500 ppm
I20260811 01:04:49.189685 14134 webserver.cc:460] Webserver started at http://127.13.30.131:35019/ using document root <none> and password file <none>
I20260811 01:04:49.189967 14134 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:49.190047 14134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:49.190184 14134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:49.191399 14134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/data/instance:
uuid: "e24782df9f144a338244c10287a108c9"
format_stamp: "Formatted at 2026-08-11 01:04:49 on dist-test-slave-42z9"
server_key: "9f77fd8aa07ea242b09012b7c8e6b264"
server_key_iv: "3d4f60429faa220527e6c628d6a3aace"
server_key_version: "encryptionkey@0"
I20260811 01:04:49.191738 14134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance:
uuid: "e24782df9f144a338244c10287a108c9"
format_stamp: "Formatted at 2026-08-11 01:04:49 on dist-test-slave-42z9"
server_key: "9f77fd8aa07ea242b09012b7c8e6b264"
server_key_iv: "3d4f60429faa220527e6c628d6a3aace"
server_key_version: "encryptionkey@0"
I20260811 01:04:49.193044 14134 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:04:49.193768 14155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:49.193913 14134 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:49.194002 14134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/wal
uuid: "e24782df9f144a338244c10287a108c9"
format_stamp: "Formatted at 2026-08-11 01:04:49 on dist-test-slave-42z9"
server_key: "9f77fd8aa07ea242b09012b7c8e6b264"
server_key_iv: "3d4f60429faa220527e6c628d6a3aace"
server_key_version: "encryptionkey@0"
I20260811 01:04:49.194072 14134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:49.215396 14134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:49.215765 14134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:49.215911 14134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:49.216164 14134 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:04:49.216527 14134 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:04:49.216565 14134 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:49.216596 14134 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:04:49.216614 14134 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:49.222626 14134 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.131:36323
I20260811 01:04:49.222668 14341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.131:36323 every 8 connection(s)
I20260811 01:04:49.223016 14134 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/data/info.pb
I20260811 01:04:49.225278 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 14134
I20260811 01:04:49.225375 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/wal/instance
I20260811 01:04:49.225620 13434 external_mini_cluster.cc:1428] Setting key b55dd7a08a5488689aba389de2cc984e
I20260811 01:04:49.228670 13638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.223773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.131:60343 (local address 127.13.30.190:35931)
0811 01:04:49.223842 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:49.223844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:49.224074 (+ 230us) server_negotiation.cc:407] Connection header received
0811 01:04:49.224619 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:49.224621 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:49.224634 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:49.224689 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:49.225411 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.226084 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.227270 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.227466 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.227522 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.228384 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:49.228385 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:49.228386 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:49.228391 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:49.228408 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:49.228412 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:49.228454 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:49.228551 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 01:04:49.228583 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 01:04:49.228916 14344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.223742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:35931 (local address 127.13.30.131:60343)
0811 01:04:49.223949 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:49.223984 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:49.224516 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:49.224763 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:49.224768 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:49.224779 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:04:49.225306 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:49.225311 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.226182 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.226183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:49.227188 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:49.227192 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.227540 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.227541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:49.227675 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.228238 (+ 563us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:04:49.228238 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:04:49.228271 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:04:49.228297 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:04:49.228476 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:04:49.228482 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:04:49.228485 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:04:49.228546 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 01:04:49.228667 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":91,"threads_started":1}
I20260811 01:04:49.229526 14342 heartbeater.cc:347] Connected to a master server at 127.13.30.190:35931
I20260811 01:04:49.229741 14342 heartbeater.cc:464] Registering TS with master...
I20260811 01:04:49.230027 14342 heartbeater.cc:511] Master 127.13.30.190:35931 requested a full tablet report, sending...
I20260811 01:04:49.230518 13574 ts_manager.cc:194] Registered new tserver with Master: e24782df9f144a338244c10287a108c9 (127.13.30.131:36323)
I20260811 01:04:49.230880 13574 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.30.131:60343
I20260811 01:04:49.237949 13434 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:04:49.242388 13638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.239437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40222 (local address 127.13.30.190:35931)
0811 01:04:49.239505 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:49.239507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:49.239579 (+ 72us) server_negotiation.cc:407] Connection header received
0811 01:04:49.239644 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:49.239645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:49.239655 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:49.239702 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:49.239867 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.240391 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.241149 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.241344 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.241398 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.242159 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:49.242160 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:49.242160 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:49.242165 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:49.242179 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:49.242183 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:49.242225 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:49.242276 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 01:04:49.242304 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 01:04:49.243997 13574 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40222:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:04:49.245714 13574 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:04:49.251995 14354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.247996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.130:37681 (local address 127.0.0.1:54302)
0811 01:04:49.248309 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:49.248318 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:49.248376 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:49.248616 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:49.248618 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:49.248620 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:49.248665 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:49.248667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.249963 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.249964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:49.250876 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:49.250879 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.251770 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.251770 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:49.251825 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.251829 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 01:04:49.251873 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 01:04:49.251906 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":24,"thread_start_us":65,"threads_started":1}
I20260811 01:04:49.252045 14361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.248127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54302 (local address 127.13.30.130:37681)
0811 01:04:49.248283 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:49.248287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:49.248364 (+ 77us) server_negotiation.cc:407] Connection header received
0811 01:04:49.248448 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:49.248450 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:49.248481 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:49.248550 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:49.248741 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.249870 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.250967 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.251569 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.251637 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.251734 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:49.251902 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 01:04:49.251955 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":96,"threads_started":1}
I20260811 01:04:49.252259 14355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.247790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:36323 (local address 127.0.0.1:56696)
0811 01:04:49.248140 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:49.248183 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:49.248257 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:49.248532 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:49.248535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:49.248537 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:49.248612 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:49.248615 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.249612 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.249613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:49.250746 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:49.250749 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.251612 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.251613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:49.251700 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.251713 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 01:04:49.251804 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 01:04:49.251866 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":65,"threads_started":1}
I20260811 01:04:49.252403 14359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.248004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56696 (local address 127.13.30.131:36323)
0811 01:04:49.248388 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:49.248392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:49.248401 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:04:49.248434 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:49.248436 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:49.248448 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:49.248521 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:49.248698 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.249538 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.250844 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.251522 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.251599 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.251697 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:49.251953 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 01:04:49.252012 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":96,"threads_started":1}
I20260811 01:04:49.252686 14357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.247798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:33959 (local address 127.0.0.1:58434)
0811 01:04:49.248204 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:49.248212 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:49.248257 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:49.248790 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:49.248791 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:49.248794 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:49.248827 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:49.248829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.250107 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.250108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:49.251103 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:49.251106 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.252458 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.252459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:49.252527 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.252532 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:04:49.252576 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 01:04:49.252619 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":90,"threads_started":1}
I20260811 01:04:49.252987 14356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.247924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58434 (local address 127.13.30.129:33959)
0811 01:04:49.248151 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:49.248157 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:49.248585 (+ 428us) server_negotiation.cc:407] Connection header received
0811 01:04:49.248632 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:49.248634 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:49.248649 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:49.248726 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:49.248911 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.250027 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.251190 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.251906 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.251971 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.252053 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:49.252856 (+ 803us) server_negotiation.cc:299] Negotiation successful
0811 01:04:49.252907 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":112,"threads_started":1}
I20260811 01:04:49.252957 14010 tablet_service.cc:1467] Processing CreateTablet for tablet ee7727af5797403cb2afa5279ef93667 (DEFAULT_TABLE table=test-table [id=a3afc466d8ce4b188109750fa12d7f62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:49.253412 14010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee7727af5797403cb2afa5279ef93667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:49.253333 14231 tablet_service.cc:1467] Processing CreateTablet for tablet ee7727af5797403cb2afa5279ef93667 (DEFAULT_TABLE table=test-table [id=a3afc466d8ce4b188109750fa12d7f62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:49.253727 14231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee7727af5797403cb2afa5279ef93667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:49.253623 13791 tablet_service.cc:1467] Processing CreateTablet for tablet ee7727af5797403cb2afa5279ef93667 (DEFAULT_TABLE table=test-table [id=a3afc466d8ce4b188109750fa12d7f62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:04:49.253949 13791 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee7727af5797403cb2afa5279ef93667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:49.256217 14362 tablet_bootstrap.cc:492] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059: Bootstrap starting.
I20260811 01:04:49.257048 14363 tablet_bootstrap.cc:492] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9: Bootstrap starting.
I20260811 01:04:49.257184 14362 tablet_bootstrap.cc:654] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:49.257277 14364 tablet_bootstrap.cc:492] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4: Bootstrap starting.
I20260811 01:04:49.257628 14362 log.cc:824] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:49.257715 14363 tablet_bootstrap.cc:654] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:49.257910 14364 tablet_bootstrap.cc:654] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:49.258030 14363 log.cc:824] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:49.258219 14364 log.cc:824] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:49.258462 14362 tablet_bootstrap.cc:492] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059: No bootstrap required, opened a new log
I20260811 01:04:49.258538 14362 ts_tablet_manager.cc:1397] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:04:49.258749 14363 tablet_bootstrap.cc:492] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9: No bootstrap required, opened a new log
I20260811 01:04:49.258821 14363 ts_tablet_manager.cc:1397] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 01:04:49.259007 14364 tablet_bootstrap.cc:492] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4: No bootstrap required, opened a new log
I20260811 01:04:49.259073 14364 ts_tablet_manager.cc:1397] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:04:49.260692 14362 raft_consensus.cc:348] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24782df9f144a338244c10287a108c9" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36323 } } peers { permanent_uuid: "5e23f2111d574fbf857c6dd19879c2a4" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33959 } } peers { permanent_uuid: "baf9341f0a8e4137a0c1f6a41d969059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37681 } }
I20260811 01:04:49.260833 14362 raft_consensus.cc:374] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:49.260867 14362 raft_consensus.cc:729] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baf9341f0a8e4137a0c1f6a41d969059, State: Initialized, Role: FOLLOWER
I20260811 01:04:49.260982 14362 consensus_queue.cc:260] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24782df9f144a338244c10287a108c9" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36323 } } peers { permanent_uuid: "5e23f2111d574fbf857c6dd19879c2a4" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33959 } } peers { permanent_uuid: "baf9341f0a8e4137a0c1f6a41d969059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37681 } }
I20260811 01:04:49.261258 14362 ts_tablet_manager.cc:1428] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:04:49.261274 14130 heartbeater.cc:503] Master 127.13.30.190:35931 was elected leader, sending a full tablet report...
I20260811 01:04:49.261317 14363 raft_consensus.cc:348] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24782df9f144a338244c10287a108c9" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36323 } } peers { permanent_uuid: "5e23f2111d574fbf857c6dd19879c2a4" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33959 } } peers { permanent_uuid: "baf9341f0a8e4137a0c1f6a41d969059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37681 } }
I20260811 01:04:49.261507 14363 raft_consensus.cc:374] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:49.261547 14363 raft_consensus.cc:729] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e24782df9f144a338244c10287a108c9, State: Initialized, Role: FOLLOWER
I20260811 01:04:49.261539 14364 raft_consensus.cc:348] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24782df9f144a338244c10287a108c9" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36323 } } peers { permanent_uuid: "5e23f2111d574fbf857c6dd19879c2a4" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33959 } } peers { permanent_uuid: "baf9341f0a8e4137a0c1f6a41d969059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37681 } }
I20260811 01:04:49.261689 14363 consensus_queue.cc:260] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24782df9f144a338244c10287a108c9" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36323 } } peers { permanent_uuid: "5e23f2111d574fbf857c6dd19879c2a4" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33959 } } peers { permanent_uuid: "baf9341f0a8e4137a0c1f6a41d969059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37681 } }
I20260811 01:04:49.261735 14364 raft_consensus.cc:374] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:49.261771 14364 raft_consensus.cc:729] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e23f2111d574fbf857c6dd19879c2a4, State: Initialized, Role: FOLLOWER
I20260811 01:04:49.261893 14364 consensus_queue.cc:260] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24782df9f144a338244c10287a108c9" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36323 } } peers { permanent_uuid: "5e23f2111d574fbf857c6dd19879c2a4" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33959 } } peers { permanent_uuid: "baf9341f0a8e4137a0c1f6a41d969059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37681 } }
I20260811 01:04:49.261947 14363 ts_tablet_manager.cc:1428] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 01:04:49.262066 14342 heartbeater.cc:503] Master 127.13.30.190:35931 was elected leader, sending a full tablet report...
I20260811 01:04:49.262138 14364 ts_tablet_manager.cc:1428] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:04:49.262166 13896 heartbeater.cc:503] Master 127.13.30.190:35931 was elected leader, sending a full tablet report...
W20260811 01:04:49.329641 14131 tablet.cc:2369] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:04:49.349426 14369 raft_consensus.cc:482] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:04:49.349639 14369 raft_consensus.cc:504] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24782df9f144a338244c10287a108c9" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36323 } } peers { permanent_uuid: "5e23f2111d574fbf857c6dd19879c2a4" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33959 } } peers { permanent_uuid: "baf9341f0a8e4137a0c1f6a41d969059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37681 } }
I20260811 01:04:49.350045 14369 leader_election.cc:288] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e24782df9f144a338244c10287a108c9 (127.13.30.131:36323), 5e23f2111d574fbf857c6dd19879c2a4 (127.13.30.129:33959)
I20260811 01:04:49.352890 14356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.350419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:44801 (local address 127.13.30.129:33959)
0811 01:04:49.350476 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:49.350478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:49.350485 (+ 7us) server_negotiation.cc:407] Connection header received
0811 01:04:49.350513 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:49.350514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:49.350524 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:49.350573 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:49.350717 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.351211 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.352187 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.352561 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.352625 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.352635 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:49.352772 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 01:04:49.352809 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 01:04:49.352916 14132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.350268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:33959 (local address 127.13.30.130:44801)
0811 01:04:49.350327 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:49.350343 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:49.350410 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:49.350581 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:49.350582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:49.350584 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:49.350654 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:49.350656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.351293 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.351294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:49.352084 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:49.352087 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.352633 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.352634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:49.352709 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.352712 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:04:49.352758 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:04:49.352807 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 01:04:49.352952 14359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.350394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.30.130:32791 (local address 127.13.30.131:36323)
0811 01:04:49.350454 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:49.350457 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:49.350540 (+ 83us) server_negotiation.cc:407] Connection header received
0811 01:04:49.350595 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:49.350596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:49.350606 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:49.350655 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:04:49.350804 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.351284 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.352235 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.352628 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.352692 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.352701 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:49.352838 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 01:04:49.352882 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 01:04:49.353184 14375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.350266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.131:36323 (local address 127.13.30.130:32791)
0811 01:04:49.350472 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:49.350481 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:04:49.350539 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:04:49.350682 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:04:49.350682 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:04:49.350684 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:04:49.350745 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:49.350747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.351368 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.351369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:49.352145 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:04:49.352148 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.352709 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.352710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:04:49.352777 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.352780 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 01:04:49.352826 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 01:04:49.352866 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":19,"thread_start_us":114,"threads_started":1}
I20260811 01:04:49.353336 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee7727af5797403cb2afa5279ef93667" candidate_uuid: "baf9341f0a8e4137a0c1f6a41d969059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e23f2111d574fbf857c6dd19879c2a4" is_pre_election: true
I20260811 01:04:49.353540 13822 raft_consensus.cc:2454] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baf9341f0a8e4137a0c1f6a41d969059 in term 0.
I20260811 01:04:49.353768 13931 leader_election.cc:302] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e23f2111d574fbf857c6dd19879c2a4, baf9341f0a8e4137a0c1f6a41d969059; no voters:
I20260811 01:04:49.353811 14263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee7727af5797403cb2afa5279ef93667" candidate_uuid: "baf9341f0a8e4137a0c1f6a41d969059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e24782df9f144a338244c10287a108c9" is_pre_election: true
I20260811 01:04:49.353969 14263 raft_consensus.cc:2454] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baf9341f0a8e4137a0c1f6a41d969059 in term 0.
I20260811 01:04:49.354001 14369 raft_consensus.cc:2781] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:04:49.354060 14369 raft_consensus.cc:482] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:04:49.354085 14369 raft_consensus.cc:3037] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:49.354856 14369 raft_consensus.cc:504] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24782df9f144a338244c10287a108c9" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36323 } } peers { permanent_uuid: "5e23f2111d574fbf857c6dd19879c2a4" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33959 } } peers { permanent_uuid: "baf9341f0a8e4137a0c1f6a41d969059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37681 } }
I20260811 01:04:49.354992 14369 leader_election.cc:288] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [CANDIDATE]: Term 1 election: Requested vote from peers e24782df9f144a338244c10287a108c9 (127.13.30.131:36323), 5e23f2111d574fbf857c6dd19879c2a4 (127.13.30.129:33959)
I20260811 01:04:49.355162 14263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee7727af5797403cb2afa5279ef93667" candidate_uuid: "baf9341f0a8e4137a0c1f6a41d969059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e24782df9f144a338244c10287a108c9"
I20260811 01:04:49.355192 13822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee7727af5797403cb2afa5279ef93667" candidate_uuid: "baf9341f0a8e4137a0c1f6a41d969059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e23f2111d574fbf857c6dd19879c2a4"
I20260811 01:04:49.355247 14263 raft_consensus.cc:3037] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:49.355279 13822 raft_consensus.cc:3037] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:49.356024 13822 raft_consensus.cc:2454] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baf9341f0a8e4137a0c1f6a41d969059 in term 1.
I20260811 01:04:49.356038 14263 raft_consensus.cc:2454] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baf9341f0a8e4137a0c1f6a41d969059 in term 1.
I20260811 01:04:49.356225 13937 leader_election.cc:302] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baf9341f0a8e4137a0c1f6a41d969059, e24782df9f144a338244c10287a108c9; no voters:
I20260811 01:04:49.356351 14369 raft_consensus.cc:2781] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:49.356520 14369 raft_consensus.cc:686] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [term 1 LEADER]: Becoming Leader. State: Replica: baf9341f0a8e4137a0c1f6a41d969059, State: Running, Role: LEADER
I20260811 01:04:49.356624 14369 consensus_queue.cc:237] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24782df9f144a338244c10287a108c9" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36323 } } peers { permanent_uuid: "5e23f2111d574fbf857c6dd19879c2a4" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33959 } } peers { permanent_uuid: "baf9341f0a8e4137a0c1f6a41d969059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37681 } }
I20260811 01:04:49.357676 13572 catalog_manager.cc:5495] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 reported cstate change: term changed from 0 to 1, leader changed from <none> to baf9341f0a8e4137a0c1f6a41d969059 (127.13.30.130). New cstate: current_term: 1 leader_uuid: "baf9341f0a8e4137a0c1f6a41d969059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e24782df9f144a338244c10287a108c9" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e23f2111d574fbf857c6dd19879c2a4" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baf9341f0a8e4137a0c1f6a41d969059" member_type: VOTER last_known_addr { host: "127.13.30.130" port: 37681 } health_report { overall_health: HEALTHY } } }
I20260811 01:04:49.373387 14361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.370650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54304 (local address 127.13.30.130:37681)
0811 01:04:49.370715 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:49.370716 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:49.370723 (+ 7us) server_negotiation.cc:407] Connection header received
0811 01:04:49.370760 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:49.370761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:49.370781 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:49.370849 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:04:49.370970 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.371444 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.372435 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:49.372678 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:49.372748 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:49.372928 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:04:49.373080 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:04:49.373193 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:49.373210 (+ 17us) server_negotiation.cc:299] Negotiation successful
0811 01:04:49.373244 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 01:04:49.375988 14263 raft_consensus.cc:1261] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9 [term 1 FOLLOWER]: Refusing update from remote peer baf9341f0a8e4137a0c1f6a41d969059: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:04:49.375988 13822 raft_consensus.cc:1261] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4 [term 1 FOLLOWER]: Refusing update from remote peer baf9341f0a8e4137a0c1f6a41d969059: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:04:49.376488 14377 consensus_queue.cc:1035] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e23f2111d574fbf857c6dd19879c2a4" member_type: VOTER last_known_addr { host: "127.13.30.129" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:04:49.376685 14369 consensus_queue.cc:1035] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e24782df9f144a338244c10287a108c9" member_type: VOTER last_known_addr { host: "127.13.30.131" port: 36323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:04:49.379999 14382 mvcc.cc:205] Tried to move back new op lower bound from 7317136545280651264 to 7317136545205460992. Current Snapshot: MvccSnapshot[applied={T|T < 7317136545280651264}]
I20260811 01:04:49.382495 13571 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40222:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:04:49.382603 13571 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40222:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:04:49.383678 13571 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 95336f41406e44e2839702118a9c64bc: Sending DeleteTablet for 3 replicas of tablet ee7727af5797403cb2afa5279ef93667
I20260811 01:04:49.384111 13791 tablet_service.cc:1514] Processing DeleteTablet for tablet ee7727af5797403cb2afa5279ef93667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:49 UTC) from {username='slave'} at 127.0.0.1:58434
I20260811 01:04:49.384171 14010 tablet_service.cc:1514] Processing DeleteTablet for tablet ee7727af5797403cb2afa5279ef93667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:49 UTC) from {username='slave'} at 127.0.0.1:54302
I20260811 01:04:49.384364 14397 tablet_replica.cc:330] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4: stopping tablet replica
I20260811 01:04:49.384367 14231 tablet_service.cc:1514] Processing DeleteTablet for tablet ee7727af5797403cb2afa5279ef93667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:04:49 UTC) from {username='slave'} at 127.0.0.1:56696
I20260811 01:04:49.384514 14397 raft_consensus.cc:2229] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:49.384641 14397 raft_consensus.cc:2258] T ee7727af5797403cb2afa5279ef93667 P 5e23f2111d574fbf857c6dd19879c2a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:49.384928 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 13686
I20260811 01:04:49.395800 14401 tablet_replica.cc:330] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9: stopping tablet replica
I20260811 01:04:49.384960 14399 tablet_replica.cc:330] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059: stopping tablet replica
I20260811 01:04:49.396322 14399 raft_consensus.cc:2229] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:04:49.396515 14401 raft_consensus.cc:2229] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:04:49.396778 14399 raft_consensus.cc:2258] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:49.397049 14401 raft_consensus.cc:2258] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:04:49.399122 14401 ts_tablet_manager.cc:1905] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:49.399394 14399 ts_tablet_manager.cc:1905] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:04:49.401198 14401 ts_tablet_manager.cc:1918] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:49.401319 14401 log.cc:1196] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-2/wal/wals/ee7727af5797403cb2afa5279ef93667
I20260811 01:04:49.401715 14401 ts_tablet_manager.cc:1939] T ee7727af5797403cb2afa5279ef93667 P e24782df9f144a338244c10287a108c9: Deleting consensus metadata
I20260811 01:04:49.401868 14399 ts_tablet_manager.cc:1918] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:04:49.402078 14399 log.cc:1196] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059: Deleting WAL directory at /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786410030080353-13434-0/minicluster-data/ts-1/wal/wals/ee7727af5797403cb2afa5279ef93667
I20260811 01:04:49.402405 13554 catalog_manager.cc:4841] TS e24782df9f144a338244c10287a108c9 (127.13.30.131:36323): tablet ee7727af5797403cb2afa5279ef93667 (table test-table [id=a3afc466d8ce4b188109750fa12d7f62]) successfully deleted
I20260811 01:04:49.402570 14399 ts_tablet_manager.cc:1939] T ee7727af5797403cb2afa5279ef93667 P baf9341f0a8e4137a0c1f6a41d969059: Deleting consensus metadata
I20260811 01:04:49.403196 13554 catalog_manager.cc:4841] TS baf9341f0a8e4137a0c1f6a41d969059 (127.13.30.130:37681): tablet ee7727af5797403cb2afa5279ef93667 (table test-table [id=a3afc466d8ce4b188109750fa12d7f62]) successfully deleted
W20260811 01:04:49.407387 13548 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.30.129:33959 (error 108)
I20260811 01:04:49.407750 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 13905
I20260811 01:04:49.419098 14355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:49.418923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.129:33959 (local address 127.0.0.1:58444)
0811 01:04:49.418990 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 01:04:49.419041 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.129:33959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 01:04:49.419265 13548 catalog_manager.cc:4584] TS 5e23f2111d574fbf857c6dd19879c2a4 (127.13.30.129:33959): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ee7727af5797403cb2afa5279ef93667: Network error: Client connection negotiation failed: client connection to 127.13.30.129:33959: connect: Connection refused (error 111)
I20260811 01:04:49.430263 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 14134
I20260811 01:04:49.451676 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 13521
2026-08-11T01:04:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (839 ms)
[----------] 6 tests from EncryptionPolicyTest (9279 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:04:49 dist-test-slave-42z9 krb5kdc[14406](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:04:49 dist-test-slave-42z9 krb5kdc[14406](info): set up 2 sockets
Aug 11 01:04:49 dist-test-slave-42z9 krb5kdc[14406](info): commencing operation
krb5kdc: starting...
W20260811 01:04:50.648533 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:04:50 dist-test-slave-42z9 krb5kdc[14406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:04:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:04:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:04:50.793627 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39375
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39375
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:50.878597 14428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:50.878841 14428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:50.878875 14428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:50.880141 14428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:04:50.880191 14428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:50.880210 14428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:50.880226 14428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:04:50.880242 14428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:04:50.881898 14428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39375
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:50.882177 14428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:50.882405 14428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:50.887650 14446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:50.887650 14443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:50.887679 14444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:50.888002 14428 server_base.cc:1034] running on GCE node
I20260811 01:04:50.888274 14428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:50.888595 14428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:50.889743 14428 hybrid_clock.cc:648] HybridClock initialized: now 1786410290889721 us; error 36 us; skew 500 ppm
Aug 11 01:04:50 dist-test-slave-42z9 krb5kdc[14406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410290, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:50.896023 14428 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:04:50.896579 14428 webserver.cc:460] Webserver started at http://127.0.0.1:40131/ using document root <none> and password file <none>
I20260811 01:04:50.896831 14428 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:50.896888 14428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:50.897019 14428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:50.898161 14428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "078f285fae4b46e0b43bb045e323a88f"
format_stamp: "Formatted at 2026-08-11 01:04:50 on dist-test-slave-42z9"
server_key: "58716c8f7fae8f1e08f378ff87c1758b"
server_key_iv: "176a7bb2323454d6d9619c557db6a406"
server_key_version: "encryptionkey@0"
I20260811 01:04:50.898518 14428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "078f285fae4b46e0b43bb045e323a88f"
format_stamp: "Formatted at 2026-08-11 01:04:50 on dist-test-slave-42z9"
server_key: "58716c8f7fae8f1e08f378ff87c1758b"
server_key_iv: "176a7bb2323454d6d9619c557db6a406"
server_key_version: "encryptionkey@0"
I20260811 01:04:50.899950 14428 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:04:50.900709 14455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:50.900869 14428 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 01:04:50.900961 14428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "078f285fae4b46e0b43bb045e323a88f"
format_stamp: "Formatted at 2026-08-11 01:04:50 on dist-test-slave-42z9"
server_key: "58716c8f7fae8f1e08f378ff87c1758b"
server_key_iv: "176a7bb2323454d6d9619c557db6a406"
server_key_version: "encryptionkey@0"
I20260811 01:04:50.901031 14428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:50.912730 14428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:50.919299 14428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:50.919499 14428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:50.924052 14428 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39375
I20260811 01:04:50.924108 14536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39375 every 8 connection(s)
I20260811 01:04:50.924448 14428 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:04:50.925351 14537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:50.927831 14537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f: Bootstrap starting.
I20260811 01:04:50.928431 14537 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:50.928712 14537 log.cc:824] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:50.929821 14537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f: No bootstrap required, opened a new log
I20260811 01:04:50.930302 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 14428
I20260811 01:04:50.930406 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:04:50.930585 13434 external_mini_cluster.cc:1428] Setting key 725b46a55584a53422d952d5adeb5fa1
I20260811 01:04:50.932015 14537 raft_consensus.cc:348] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "078f285fae4b46e0b43bb045e323a88f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39375 } }
I20260811 01:04:50.932220 14537 raft_consensus.cc:374] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:50.932255 14537 raft_consensus.cc:729] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 078f285fae4b46e0b43bb045e323a88f, State: Initialized, Role: FOLLOWER
I20260811 01:04:50.932382 14537 consensus_queue.cc:260] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "078f285fae4b46e0b43bb045e323a88f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39375 } }
I20260811 01:04:50.932476 14537 raft_consensus.cc:388] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:04:50.932543 14537 raft_consensus.cc:482] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:04:50.932595 14537 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:50.933225 14537 raft_consensus.cc:504] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "078f285fae4b46e0b43bb045e323a88f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39375 } }
I20260811 01:04:50.933337 14537 leader_election.cc:302] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 078f285fae4b46e0b43bb045e323a88f; no voters:
I20260811 01:04:50.933533 14537 leader_election.cc:288] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:04:50.933568 14544 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:50.933749 14544 raft_consensus.cc:686] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [term 1 LEADER]: Becoming Leader. State: Replica: 078f285fae4b46e0b43bb045e323a88f, State: Running, Role: LEADER
I20260811 01:04:50.933799 14537 sys_catalog.cc:564] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:04:50.933928 14544 consensus_queue.cc:237] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "078f285fae4b46e0b43bb045e323a88f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39375 } }
I20260811 01:04:50.934321 14546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "078f285fae4b46e0b43bb045e323a88f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "078f285fae4b46e0b43bb045e323a88f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39375 } } }
I20260811 01:04:50.934401 14546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:50.934643 14549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 078f285fae4b46e0b43bb045e323a88f. Latest consensus state: current_term: 1 leader_uuid: "078f285fae4b46e0b43bb045e323a88f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "078f285fae4b46e0b43bb045e323a88f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39375 } } }
I20260811 01:04:50.934917 14549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f [sys.catalog]: This master's current role is: LEADER
W20260811 01:04:50.935649 14574 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:04:50.935693 14574 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:04:50.935734 14561 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:04:50.935896 14561 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:04:50.937286 14561 catalog_manager.cc:1347] Generated new cluster ID: f6be54c2b3784320a2b23eaa0c1e8919
I20260811 01:04:50.937328 14561 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 01:04:50 dist-test-slave-42z9 krb5kdc[14406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 01:04:50.942905 14543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:50.931142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56729 (local address 127.0.0.1:39375)
0811 01:04:50.931355 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:50.931365 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:50.931417 (+ 52us) server_negotiation.cc:407] Connection header received
0811 01:04:50.932214 (+ 797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:50.932224 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:50.932288 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:50.932440 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:50.933096 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:50.934490 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:50.935541 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:50.936122 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:50.936240 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:50.939115 (+ 2875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:50.939120 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:50.939121 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:50.939135 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:50.941208 (+ 2073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:50.941652 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:50.941655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:50.941656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:50.941769 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:50.942001 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:50.942003 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:50.942003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:50.942327 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:50.942493 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:50.942585 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 01:04:50.942693 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":96,"threads_started":1}
I20260811 01:04:50.944142 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:04:50.957639 14543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:50.949824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49015 (local address 127.0.0.1:39375)
0811 01:04:50.949879 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:50.949881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:50.950120 (+ 239us) server_negotiation.cc:407] Connection header received
0811 01:04:50.950178 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:50.950180 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:50.950194 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:50.950251 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:50.950942 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:50.951771 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:50.952796 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:50.953180 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:50.953265 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:50.954768 (+ 1503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:50.954770 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:50.954770 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:50.954780 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:50.956355 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:50.956785 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:50.956786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:50.956786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:50.956850 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:50.957049 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:50.957049 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:50.957049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:50.957197 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:50.957301 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:50.957412 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 01:04:50.957530 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 01:04:50.962148 14561 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:04:50.962700 14561 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:04:50.971362 14561 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 078f285fae4b46e0b43bb045e323a88f: Generated new TSK 0
I20260811 01:04:50.971786 14561 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:04:50.977945 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 14428
W20260811 01:04:50.989634 14403 connection.cc:535] client connection to 127.0.0.1:39375 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39375): Connection reset by peer (error 104)
2026-08-11T01:04:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1524 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:04:51 dist-test-slave-42z9 krb5kdc[14587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:04:51 dist-test-slave-42z9 krb5kdc[14587](info): set up 2 sockets
Aug 11 01:04:51 dist-test-slave-42z9 krb5kdc[14587](info): commencing operation
krb5kdc: starting...
W20260811 01:04:52.184187 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:04:52 dist-test-slave-42z9 krb5kdc[14587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:04:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:04:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:04:52.333107 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33991
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33991
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:52.427783 14608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:52.428045 14608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:52.428071 14608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:52.429324 14608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:04:52.429378 14608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:52.429392 14608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:52.429404 14608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:04:52.429414 14608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:04:52.431174 14608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33991
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:52.431491 14608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:52.431743 14608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:52.437481 14618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:52.437537 14621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:52.437553 14617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:52.437932 14608 server_base.cc:1034] running on GCE node
I20260811 01:04:52.438239 14608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:52.438588 14608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:52.439772 14608 hybrid_clock.cc:648] HybridClock initialized: now 1786410292439762 us; error 42 us; skew 500 ppm
Aug 11 01:04:52 dist-test-slave-42z9 krb5kdc[14587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410292, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:52.442790 14608 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:04:52.443341 14608 webserver.cc:460] Webserver started at http://127.0.0.1:39561/ using document root <none> and password file <none>
I20260811 01:04:52.443581 14608 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:52.443634 14608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:52.443770 14608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:52.444957 14608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "3540a3a7f84545f6aabd5bfa4996b669"
format_stamp: "Formatted at 2026-08-11 01:04:52 on dist-test-slave-42z9"
server_key: "39c52fc8ff5a6b84906297bb99a8aedd"
server_key_iv: "7ef6e99970d776e4e3a483f94521c46a"
server_key_version: "encryptionkey@0"
I20260811 01:04:52.445333 14608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "3540a3a7f84545f6aabd5bfa4996b669"
format_stamp: "Formatted at 2026-08-11 01:04:52 on dist-test-slave-42z9"
server_key: "39c52fc8ff5a6b84906297bb99a8aedd"
server_key_iv: "7ef6e99970d776e4e3a483f94521c46a"
server_key_version: "encryptionkey@0"
I20260811 01:04:52.446867 14608 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:52.447875 14629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:52.448086 14608 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:52.448186 14608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "3540a3a7f84545f6aabd5bfa4996b669"
format_stamp: "Formatted at 2026-08-11 01:04:52 on dist-test-slave-42z9"
server_key: "39c52fc8ff5a6b84906297bb99a8aedd"
server_key_iv: "7ef6e99970d776e4e3a483f94521c46a"
server_key_version: "encryptionkey@0"
I20260811 01:04:52.448259 14608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:52.466516 14608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:52.468767 14608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:52.468953 14608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:52.473358 14608 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33991
I20260811 01:04:52.473398 14719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33991 every 8 connection(s)
I20260811 01:04:52.473820 14608 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:04:52.474828 14720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:52.477418 14720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669: Bootstrap starting.
I20260811 01:04:52.478130 14720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:52.478430 14720 log.cc:824] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:52.479382 14720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669: No bootstrap required, opened a new log
I20260811 01:04:52.481089 14720 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3540a3a7f84545f6aabd5bfa4996b669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33991 } }
I20260811 01:04:52.481256 14720 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:52.481279 14720 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3540a3a7f84545f6aabd5bfa4996b669, State: Initialized, Role: FOLLOWER
I20260811 01:04:52.481434 14720 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3540a3a7f84545f6aabd5bfa4996b669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33991 } }
I20260811 01:04:52.481551 14720 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:04:52.481576 14720 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:04:52.481626 14720 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:52.482016 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 14608
I20260811 01:04:52.482142 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:04:52.482295 14720 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3540a3a7f84545f6aabd5bfa4996b669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33991 } }
I20260811 01:04:52.482335 13434 external_mini_cluster.cc:1428] Setting key 13ef05e2d57041aeba48bd91b38284f7
I20260811 01:04:52.482409 14720 leader_election.cc:302] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3540a3a7f84545f6aabd5bfa4996b669; no voters:
I20260811 01:04:52.482601 14720 leader_election.cc:288] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:04:52.482654 14725 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:52.482878 14725 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [term 1 LEADER]: Becoming Leader. State: Replica: 3540a3a7f84545f6aabd5bfa4996b669, State: Running, Role: LEADER
I20260811 01:04:52.482899 14720 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:04:52.483062 14725 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3540a3a7f84545f6aabd5bfa4996b669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33991 } }
I20260811 01:04:52.483718 14730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3540a3a7f84545f6aabd5bfa4996b669. Latest consensus state: current_term: 1 leader_uuid: "3540a3a7f84545f6aabd5bfa4996b669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3540a3a7f84545f6aabd5bfa4996b669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33991 } } }
I20260811 01:04:52.483817 14730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:52.484084 14726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3540a3a7f84545f6aabd5bfa4996b669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3540a3a7f84545f6aabd5bfa4996b669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33991 } } }
I20260811 01:04:52.484336 14726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669 [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:52.484381 14747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:04:52.485101 14747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:04:52.487392 14747 catalog_manager.cc:1347] Generated new cluster ID: 20b3772ccb1947beb4b63350c6ab29ae
I20260811 01:04:52.487462 14747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:04:52.489728 14731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:52.483031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53783 (local address 127.0.0.1:33991)
0811 01:04:52.483195 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:52.483207 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:52.483300 (+ 93us) server_negotiation.cc:407] Connection header received
0811 01:04:52.484248 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:52.484264 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:52.484340 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:52.484775 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:52.484905 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:52.486340 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:52.487367 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:52.488010 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:52.488133 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:52.488921 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:52.488926 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:52.488926 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:52.489177 (+ 251us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:52.489224 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:52.489241 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:52.489333 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:52.489425 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 01:04:52.489490 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":68,"threads_started":1}
I20260811 01:04:52.490734 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:04:52.496012 14731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:52.492299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46773 (local address 127.0.0.1:33991)
0811 01:04:52.492338 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:52.492340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:52.492471 (+ 131us) server_negotiation.cc:407] Connection header received
0811 01:04:52.492524 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:52.492525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:52.492538 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:52.492593 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:52.492721 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:52.493573 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:52.494597 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:52.494910 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:52.494988 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:52.495738 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:52.495740 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:52.495740 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:52.495746 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:52.495765 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:52.495771 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:52.495834 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:52.495893 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 01:04:52.495908 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 01:04:52.498737 14747 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:04:52.499303 14747 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:04:52.508018 14747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3540a3a7f84545f6aabd5bfa4996b669: Generated new TSK 0
I20260811 01:04:52.508275 14747 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:04:52.511623 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 14608
W20260811 01:04:52.551745 14585 connection.cc:535] client connection to 127.0.0.1:33991 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33991): Connection reset by peer (error 104)
2026-08-11T01:04:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1561 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:04:52 dist-test-slave-42z9 krb5kdc[14767](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:04:52 dist-test-slave-42z9 krb5kdc[14767](info): set up 2 sockets
Aug 11 01:04:52 dist-test-slave-42z9 krb5kdc[14767](info): commencing operation
krb5kdc: starting...
W20260811 01:04:53.752493 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:04:53 dist-test-slave-42z9 krb5kdc[14767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410293, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:04:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:04:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:04:53.896347 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40447
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40447
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:53.986865 14788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:53.987125 14788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:53.987151 14788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:53.988400 14788 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:04:53.988451 14788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:53.988466 14788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:53.988477 14788 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:04:53.988488 14788 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:04:53.990175 14788 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40447
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:53.990438 14788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:53.990645 14788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:53.996071 14797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:53.996055 14798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:53.996055 14801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:53.996626 14788 server_base.cc:1034] running on GCE node
I20260811 01:04:53.997067 14788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:53.997426 14788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:53.998636 14788 hybrid_clock.cc:648] HybridClock initialized: now 1786410293998586 us; error 73 us; skew 500 ppm
Aug 11 01:04:53 dist-test-slave-42z9 krb5kdc[14767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410293, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:54.001785 14788 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:04:54.002348 14788 webserver.cc:460] Webserver started at http://127.0.0.1:39953/ using document root <none> and password file <none>
I20260811 01:04:54.002578 14788 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:54.002628 14788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:54.002771 14788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:54.003929 14788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "f4825a4fb0ae4da68cde5720c84a4126"
format_stamp: "Formatted at 2026-08-11 01:04:53 on dist-test-slave-42z9"
server_key: "79ddc0cf39d956356c39b4be0e069a27"
server_key_iv: "42dd44b610e92b7acc2ad3d034478392"
server_key_version: "encryptionkey@0"
I20260811 01:04:54.004287 14788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "f4825a4fb0ae4da68cde5720c84a4126"
format_stamp: "Formatted at 2026-08-11 01:04:53 on dist-test-slave-42z9"
server_key: "79ddc0cf39d956356c39b4be0e069a27"
server_key_iv: "42dd44b610e92b7acc2ad3d034478392"
server_key_version: "encryptionkey@0"
I20260811 01:04:54.005708 14788 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:04:54.006702 14811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:54.006969 14788 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:54.007071 14788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "f4825a4fb0ae4da68cde5720c84a4126"
format_stamp: "Formatted at 2026-08-11 01:04:53 on dist-test-slave-42z9"
server_key: "79ddc0cf39d956356c39b4be0e069a27"
server_key_iv: "42dd44b610e92b7acc2ad3d034478392"
server_key_version: "encryptionkey@0"
I20260811 01:04:54.007150 14788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:54.010777 14788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:54.013062 14788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:54.013209 14788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:54.017869 14788 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40447
I20260811 01:04:54.017952 14908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40447 every 8 connection(s)
I20260811 01:04:54.018288 14788 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:04:54.019443 14909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:54.022298 14909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126: Bootstrap starting.
I20260811 01:04:54.022996 14909 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:54.023305 14909 log.cc:824] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:54.023908 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 14788
I20260811 01:04:54.024034 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:04:54.024187 14909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126: No bootstrap required, opened a new log
I20260811 01:04:54.024209 13434 external_mini_cluster.cc:1428] Setting key 53f7eae513f37c1f46139e94242cb00d
I20260811 01:04:54.026533 14909 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4825a4fb0ae4da68cde5720c84a4126" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40447 } }
I20260811 01:04:54.026695 14909 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:54.026731 14909 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4825a4fb0ae4da68cde5720c84a4126, State: Initialized, Role: FOLLOWER
I20260811 01:04:54.026896 14909 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4825a4fb0ae4da68cde5720c84a4126" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40447 } }
I20260811 01:04:54.027015 14909 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:04:54.027050 14909 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:04:54.027100 14909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:54.027136 14915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:54.024735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56717 (local address 127.0.0.1:40447)
0811 01:04:54.024962 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:54.024970 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:54.024997 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:04:54.025604 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:54.025613 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:54.025641 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:54.025774 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:54.026508 (+ 734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:54.026512 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:54.026512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:54.026517 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:54.026558 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:54.026569 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:54.026627 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:54.026700 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 01:04:54.026744 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":113,"threads_started":1}
I20260811 01:04:54.027897 14909 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4825a4fb0ae4da68cde5720c84a4126" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40447 } }
I20260811 01:04:54.028009 14909 leader_election.cc:302] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4825a4fb0ae4da68cde5720c84a4126; no voters:
I20260811 01:04:54.028189 14909 leader_election.cc:288] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:04:54.028214 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:04:54.028218 14917 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:54.028348 14917 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [term 1 LEADER]: Becoming Leader. State: Replica: f4825a4fb0ae4da68cde5720c84a4126, State: Running, Role: LEADER
I20260811 01:04:54.028424 14917 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4825a4fb0ae4da68cde5720c84a4126" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40447 } }
I20260811 01:04:54.028451 14909 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:04:54.028769 14917 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4825a4fb0ae4da68cde5720c84a4126. Latest consensus state: current_term: 1 leader_uuid: "f4825a4fb0ae4da68cde5720c84a4126" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4825a4fb0ae4da68cde5720c84a4126" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40447 } } }
I20260811 01:04:54.028834 14917 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:54.028821 14918 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4825a4fb0ae4da68cde5720c84a4126" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4825a4fb0ae4da68cde5720c84a4126" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40447 } } }
I20260811 01:04:54.028903 14918 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126 [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:54.029071 14921 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:04:54.029907 14921 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:04:54.031329 14915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:54.029972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41539 (local address 127.0.0.1:40447)
0811 01:04:54.030012 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:54.030014 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:54.030277 (+ 263us) server_negotiation.cc:407] Connection header received
0811 01:04:54.030339 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:54.030340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:54.030346 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:54.030408 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:54.031074 (+ 666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:54.031076 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:54.031076 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:54.031080 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:54.031099 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:54.031104 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:54.031162 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:54.031246 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 01:04:54.031262 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 01:04:54.031734 14921 catalog_manager.cc:1347] Generated new cluster ID: cb6d8a002c1e46a48a099aa88bef5853
I20260811 01:04:54.031781 14921 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:04:54.045794 14921 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:04:54.046007 14921 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:04:54.050105 14921 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4825a4fb0ae4da68cde5720c84a4126: Generated new TSK 0
I20260811 01:04:54.050338 14921 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:04:54.055192 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 14788
2026-08-11T01:04:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1550 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:04:54 dist-test-slave-42z9 krb5kdc[14956](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:04:54 dist-test-slave-42z9 krb5kdc[14956](info): set up 2 sockets
Aug 11 01:04:54 dist-test-slave-42z9 krb5kdc[14956](info): commencing operation
krb5kdc: starting...
W20260811 01:04:55.301740 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:04:55 dist-test-slave-42z9 krb5kdc[14956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:04:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:04:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:04:55.452955 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37043
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37043
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:55.542052 14973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:55.542296 14973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:55.542332 14973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:55.543574 14973 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:04:55.543632 14973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:55.543653 14973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:55.543668 14973 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:04:55.543685 14973 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:04:55.545334 14973 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:55.545662 14973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:55.545907 14973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:55.551256 14983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:55.551257 14979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:55.551257 14980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:55.551519 14973 server_base.cc:1034] running on GCE node
I20260811 01:04:55.551761 14973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:55.552067 14973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:55.553295 14973 hybrid_clock.cc:648] HybridClock initialized: now 1786410295553261 us; error 32 us; skew 500 ppm
Aug 11 01:04:55 dist-test-slave-42z9 krb5kdc[14956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410295, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:55.556618 14973 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:04:55.557133 14973 webserver.cc:460] Webserver started at http://127.0.0.1:41011/ using document root <none> and password file <none>
I20260811 01:04:55.557363 14973 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:55.557408 14973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:55.557561 14973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:55.558683 14973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "4925a78a357240528b009014ecfed774"
format_stamp: "Formatted at 2026-08-11 01:04:55 on dist-test-slave-42z9"
server_key: "5576931c4a19482f1fb3e410c2f11e42"
server_key_iv: "c4bfaf7f2182daf2db9c42ae76b4312b"
server_key_version: "encryptionkey@0"
I20260811 01:04:55.559031 14973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "4925a78a357240528b009014ecfed774"
format_stamp: "Formatted at 2026-08-11 01:04:55 on dist-test-slave-42z9"
server_key: "5576931c4a19482f1fb3e410c2f11e42"
server_key_iv: "c4bfaf7f2182daf2db9c42ae76b4312b"
server_key_version: "encryptionkey@0"
I20260811 01:04:55.560583 14973 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:04:55.561585 14992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:55.561795 14973 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:55.561900 14973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "4925a78a357240528b009014ecfed774"
format_stamp: "Formatted at 2026-08-11 01:04:55 on dist-test-slave-42z9"
server_key: "5576931c4a19482f1fb3e410c2f11e42"
server_key_iv: "c4bfaf7f2182daf2db9c42ae76b4312b"
server_key_version: "encryptionkey@0"
I20260811 01:04:55.561977 14973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:55.574505 14973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:55.577149 14973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:55.577415 14973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:55.582369 14973 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37043
I20260811 01:04:55.582484 15085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37043 every 8 connection(s)
I20260811 01:04:55.582975 14973 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:04:55.583758 15086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:55.586272 15086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774: Bootstrap starting.
I20260811 01:04:55.586941 15086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:55.587229 15086 log.cc:824] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:55.588068 15086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774: No bootstrap required, opened a new log
I20260811 01:04:55.589852 15086 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4925a78a357240528b009014ecfed774" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37043 } }
I20260811 01:04:55.590015 15086 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:55.590060 15086 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4925a78a357240528b009014ecfed774, State: Initialized, Role: FOLLOWER
I20260811 01:04:55.590139 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 14973
I20260811 01:04:55.590251 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:04:55.590219 15086 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4925a78a357240528b009014ecfed774" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37043 } }
I20260811 01:04:55.590299 15086 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:04:55.590339 15086 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:04:55.590387 15086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:55.590446 13434 external_mini_cluster.cc:1428] Setting key 7f5cb936603362053599ce3ae8db3468
I20260811 01:04:55.591792 15086 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4925a78a357240528b009014ecfed774" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37043 } }
I20260811 01:04:55.591912 15086 leader_election.cc:302] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4925a78a357240528b009014ecfed774; no voters:
I20260811 01:04:55.592083 15086 leader_election.cc:288] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:04:55.592234 15094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:55.592406 15086 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:04:55.592562 15094 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [term 1 LEADER]: Becoming Leader. State: Replica: 4925a78a357240528b009014ecfed774, State: Running, Role: LEADER
I20260811 01:04:55.592818 15094 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4925a78a357240528b009014ecfed774" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37043 } }
I20260811 01:04:55.593417 15099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4925a78a357240528b009014ecfed774. Latest consensus state: current_term: 1 leader_uuid: "4925a78a357240528b009014ecfed774" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4925a78a357240528b009014ecfed774" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37043 } } }
I20260811 01:04:55.593565 15099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:55.593586 15097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4925a78a357240528b009014ecfed774" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4925a78a357240528b009014ecfed774" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37043 } } }
I20260811 01:04:55.593645 15097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774 [sys.catalog]: This master's current role is: LEADER
W20260811 01:04:55.594329 15117 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:04:55.594414 15117 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:04:55.594535 15115 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:04:55.594702 15115 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:04:55.596273 15115 catalog_manager.cc:1347] Generated new cluster ID: 07ce352e6bd94e85913e18e367ffd76a
I20260811 01:04:55.596326 15115 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 01:04:55 dist-test-slave-42z9 krb5kdc[14956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 01:04:55.602936 15115 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:04:55.603677 15115 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:04:55.604009 15093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:55.590977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40263 (local address 127.0.0.1:37043)
0811 01:04:55.591210 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:55.591222 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:55.591266 (+ 44us) server_negotiation.cc:407] Connection header received
0811 01:04:55.591412 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:55.591420 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:55.591486 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:55.591655 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:55.592826 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:55.594281 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:55.595420 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:55.596042 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:55.596156 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:55.599090 (+ 2934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:55.599095 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:55.599095 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:55.599111 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:55.602022 (+ 2911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:55.602473 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:55.602477 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:55.602477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:55.602610 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:55.602844 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:55.602844 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:55.602845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:55.603155 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:55.603341 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:55.603422 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 01:04:55.603760 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":168,"thread_start_us":115,"threads_started":1}
I20260811 01:04:55.605243 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:04:55.608846 15115 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4925a78a357240528b009014ecfed774: Generated new TSK 0
I20260811 01:04:55.609062 15115 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:04:55.614353 15093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:55.607165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34401 (local address 127.0.0.1:37043)
0811 01:04:55.607209 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:55.607211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:55.607221 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:04:55.607275 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:55.607276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:55.607287 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:55.607349 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:55.607992 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:55.608792 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:55.609833 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:55.610175 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:55.610256 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:55.611416 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:55.611418 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:55.611418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:04:55.611425 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:55.612998 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:55.613343 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:55.613344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:55.613344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:55.613408 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:04:55.613689 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:04:55.613690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:04:55.613690 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:04:55.613842 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:55.613941 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:55.614032 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 01:04:55.614123 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 01:04:55.616900 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 14973
2026-08-11T01:04:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1529 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:04:55 dist-test-slave-42z9 krb5kdc[15133](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:04:55 dist-test-slave-42z9 krb5kdc[15133](info): set up 2 sockets
Aug 11 01:04:55 dist-test-slave-42z9 krb5kdc[15133](info): commencing operation
krb5kdc: starting...
W20260811 01:04:56.818742 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:04:56 dist-test-slave-42z9 krb5kdc[15133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:04:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:04:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:04:56.953401 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40797
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40797
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:57.040343 15153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:57.040611 15153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:57.040648 15153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:57.041986 15153 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:04:57.042044 15153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:57.042064 15153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:57.042083 15153 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:04:57.042097 15153 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:04:57.043829 15153 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40797
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:57.044147 15153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:57.044400 15153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:04:57.049922 15153 server_base.cc:1034] running on GCE node
W20260811 01:04:57.049896 15168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:57.050033 15164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:57.049857 15165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:57.050431 15153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:57.050758 15153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:57.051931 15153 hybrid_clock.cc:648] HybridClock initialized: now 1786410297051916 us; error 35 us; skew 500 ppm
Aug 11 01:04:57 dist-test-slave-42z9 krb5kdc[15133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410297, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:57.058820 15153 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:04:57.059376 15153 webserver.cc:460] Webserver started at http://127.0.0.1:41091/ using document root <none> and password file <none>
I20260811 01:04:57.059617 15153 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:57.059669 15153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:57.059806 15153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:57.060957 15153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "34344f8eae454947bf15e26750e8fa59"
format_stamp: "Formatted at 2026-08-11 01:04:57 on dist-test-slave-42z9"
server_key: "cb2f7702e34cf9995d1bd34566f4e17c"
server_key_iv: "b469f37813be497813640cae7765a521"
server_key_version: "encryptionkey@0"
I20260811 01:04:57.061313 15153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "34344f8eae454947bf15e26750e8fa59"
format_stamp: "Formatted at 2026-08-11 01:04:57 on dist-test-slave-42z9"
server_key: "cb2f7702e34cf9995d1bd34566f4e17c"
server_key_iv: "b469f37813be497813640cae7765a521"
server_key_version: "encryptionkey@0"
I20260811 01:04:57.062760 15153 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:57.063629 15183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:57.063841 15153 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:04:57.063943 15153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "34344f8eae454947bf15e26750e8fa59"
format_stamp: "Formatted at 2026-08-11 01:04:57 on dist-test-slave-42z9"
server_key: "cb2f7702e34cf9995d1bd34566f4e17c"
server_key_iv: "b469f37813be497813640cae7765a521"
server_key_version: "encryptionkey@0"
I20260811 01:04:57.064013 15153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:57.073700 15153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:57.075989 15153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:57.076133 15153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:57.081305 15153 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40797
I20260811 01:04:57.081344 15259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40797 every 8 connection(s)
I20260811 01:04:57.081750 15153 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:04:57.082983 15262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:57.085618 15262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59: Bootstrap starting.
I20260811 01:04:57.086278 15262 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:57.086553 15262 log.cc:824] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:57.087321 15262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59: No bootstrap required, opened a new log
I20260811 01:04:57.089052 15262 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34344f8eae454947bf15e26750e8fa59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40797 } }
I20260811 01:04:57.089226 15262 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:57.089249 15262 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34344f8eae454947bf15e26750e8fa59, State: Initialized, Role: FOLLOWER
I20260811 01:04:57.089386 15262 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34344f8eae454947bf15e26750e8fa59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40797 } }
I20260811 01:04:57.089489 15262 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:04:57.089524 15262 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:04:57.089576 15262 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:57.090209 15262 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34344f8eae454947bf15e26750e8fa59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40797 } }
I20260811 01:04:57.090322 15262 leader_election.cc:302] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34344f8eae454947bf15e26750e8fa59; no voters:
I20260811 01:04:57.090541 15262 leader_election.cc:288] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:04:57.090585 15270 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:57.090636 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 15153
I20260811 01:04:57.090708 15270 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [term 1 LEADER]: Becoming Leader. State: Replica: 34344f8eae454947bf15e26750e8fa59, State: Running, Role: LEADER
I20260811 01:04:57.090767 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:04:57.090785 15270 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34344f8eae454947bf15e26750e8fa59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40797 } }
I20260811 01:04:57.090837 15262 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:04:57.090955 13434 external_mini_cluster.cc:1428] Setting key e1055d28c966d3b37731f96f4cdecb56
I20260811 01:04:57.091113 15270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34344f8eae454947bf15e26750e8fa59. Latest consensus state: current_term: 1 leader_uuid: "34344f8eae454947bf15e26750e8fa59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34344f8eae454947bf15e26750e8fa59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40797 } } }
I20260811 01:04:57.091177 15270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:57.091217 15271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34344f8eae454947bf15e26750e8fa59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34344f8eae454947bf15e26750e8fa59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40797 } } }
I20260811 01:04:57.091269 15271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59 [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:57.091387 15274 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:04:57.092001 15274 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:04:57.094177 15274 catalog_manager.cc:1347] Generated new cluster ID: 2de76d28762a4efbb113a80faca28ab9
I20260811 01:04:57.094244 15274 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:04:57.109277 15274 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:04:57.110019 15274 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:04:57.110989 15279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:57.091820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43607 (local address 127.0.0.1:40797)
0811 01:04:57.093605 (+ 1785us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:57.093614 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:57.093791 (+ 177us) server_negotiation.cc:407] Connection header received
0811 01:04:57.093931 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:57.093939 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:57.094001 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:57.105611 (+ 11610us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:57.105936 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:57.107437 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:57.108654 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:57.109279 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:57.109497 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:57.110219 (+ 722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:57.110224 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:57.110224 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:57.110457 (+ 233us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:57.110499 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:57.110514 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:57.110581 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:57.110669 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 01:04:57.110751 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1732,"thread_start_us":86,"threads_started":1}
I20260811 01:04:57.111999 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:04:57.116647 15274 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34344f8eae454947bf15e26750e8fa59: Generated new TSK 0
I20260811 01:04:57.116869 15274 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:04:57.120435 15279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:57.113686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41739 (local address 127.0.0.1:40797)
0811 01:04:57.113749 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:57.113752 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:57.116488 (+ 2736us) server_negotiation.cc:407] Connection header received
0811 01:04:57.116606 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:57.116607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:57.116621 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:57.116686 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:57.116889 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:57.117520 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:57.118635 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:04:57.118864 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:04:57.118930 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:04:57.119959 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:57.119961 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:57.119962 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:57.119976 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:57.119999 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:57.120005 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:57.120051 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:57.120257 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 01:04:57.120320 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 01:04:57.123258 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 15153
2026-08-11T01:04:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1509 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:04:57 dist-test-slave-42z9 krb5kdc[15316](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:04:57 dist-test-slave-42z9 krb5kdc[15316](info): set up 2 sockets
Aug 11 01:04:57 dist-test-slave-42z9 krb5kdc[15316](info): commencing operation
krb5kdc: starting...
W20260811 01:04:58.315641 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:04:58 dist-test-slave-42z9 krb5kdc[15316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410298, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:04:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:04:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:04:58.456588 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38023
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38023
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:04:58.555658 15342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:04:58.556231 15342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:04:58.556309 15342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:04:58.557780 15342 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:04:58.557848 15342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:04:58.557870 15342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:04:58.557889 15342 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:04:58.557914 15342 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:04:58.559849 15342 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38023
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:04:58.560192 15342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:04:58.560446 15342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:04:58.566056 15348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:04:58.566056 15353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:58.566090 15342 server_base.cc:1034] running on GCE node
W20260811 01:04:58.566149 15349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:04:58.566725 15342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:04:58.567085 15342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:04:58.568265 15342 hybrid_clock.cc:648] HybridClock initialized: now 1786410298568247 us; error 42 us; skew 500 ppm
Aug 11 01:04:58 dist-test-slave-42z9 krb5kdc[15316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410298, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:04:58.571482 15342 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:04:58.572268 15342 webserver.cc:460] Webserver started at http://127.0.0.1:44853/ using document root <none> and password file <none>
I20260811 01:04:58.572587 15342 fs_manager.cc:359] Metadata directory not provided
I20260811 01:04:58.572649 15342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:04:58.572818 15342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:04:58.574338 15342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "0919b59b3b404f078540f5ed8920f80c"
format_stamp: "Formatted at 2026-08-11 01:04:58 on dist-test-slave-42z9"
server_key: "94a3952d397248645f33d463f2e617a4"
server_key_iv: "adcd7f7ebfc217b4990b15ba0b49caab"
server_key_version: "encryptionkey@0"
I20260811 01:04:58.574777 15342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "0919b59b3b404f078540f5ed8920f80c"
format_stamp: "Formatted at 2026-08-11 01:04:58 on dist-test-slave-42z9"
server_key: "94a3952d397248645f33d463f2e617a4"
server_key_iv: "adcd7f7ebfc217b4990b15ba0b49caab"
server_key_version: "encryptionkey@0"
I20260811 01:04:58.576490 15342 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 01:04:58.577678 15361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:04:58.577968 15342 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:04:58.578135 15342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "0919b59b3b404f078540f5ed8920f80c"
format_stamp: "Formatted at 2026-08-11 01:04:58 on dist-test-slave-42z9"
server_key: "94a3952d397248645f33d463f2e617a4"
server_key_iv: "adcd7f7ebfc217b4990b15ba0b49caab"
server_key_version: "encryptionkey@0"
I20260811 01:04:58.578248 15342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:04:58.582597 15342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:04:58.586021 15342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:04:58.586181 15342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:04:58.590514 15342 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38023
I20260811 01:04:58.590559 15445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38023 every 8 connection(s)
I20260811 01:04:58.590951 15342 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:04:58.592132 15447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:04:58.594677 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 15342
I20260811 01:04:58.594939 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:04:58.595183 15447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c: Bootstrap starting.
I20260811 01:04:58.595296 13434 external_mini_cluster.cc:1428] Setting key be89bf071358624e7519fe49d8cc3d8e
I20260811 01:04:58.596220 15447 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c: Neither blocks nor log segments found. Creating new log.
I20260811 01:04:58.596617 15447 log.cc:824] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:04:58.597481 15447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c: No bootstrap required, opened a new log
I20260811 01:04:58.598662 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:58.596027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38561 (local address 127.0.0.1:38023)
0811 01:04:58.596448 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:58.596463 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:58.596512 (+ 49us) server_negotiation.cc:407] Connection header received
0811 01:04:58.597100 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:58.597109 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:58.597141 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:58.597338 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:58.598223 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:58.598227 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:58.598227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:58.598234 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:58.598278 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:58.598290 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:58.598372 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:58.598410 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 01:04:58.598461 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":162,"threads_started":1}
I20260811 01:04:58.599861 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:04:58.600327 15447 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0919b59b3b404f078540f5ed8920f80c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38023 } }
I20260811 01:04:58.600503 15447 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:04:58.600538 15447 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0919b59b3b404f078540f5ed8920f80c, State: Initialized, Role: FOLLOWER
I20260811 01:04:58.600677 15447 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0919b59b3b404f078540f5ed8920f80c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38023 } }
I20260811 01:04:58.600787 15447 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:04:58.600833 15447 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:04:58.600894 15447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:04:58.601938 15447 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0919b59b3b404f078540f5ed8920f80c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38023 } }
I20260811 01:04:58.602084 15447 leader_election.cc:302] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0919b59b3b404f078540f5ed8920f80c; no voters:
I20260811 01:04:58.602289 15447 leader_election.cc:288] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:04:58.602464 15468 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:04:58.602608 15447 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:04:58.602758 15468 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [term 1 LEADER]: Becoming Leader. State: Replica: 0919b59b3b404f078540f5ed8920f80c, State: Running, Role: LEADER
I20260811 01:04:58.602955 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:04:58.601403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45575 (local address 127.0.0.1:38023)
0811 01:04:58.601487 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 01:04:58.601489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:04:58.601651 (+ 162us) server_negotiation.cc:407] Connection header received
0811 01:04:58.601757 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:04:58.601758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:04:58.601763 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:04:58.601808 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:04:58.602652 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:04:58.602653 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:04:58.602654 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:04:58.602658 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:04:58.602675 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:04:58.602681 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:04:58.602725 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 01:04:58.602880 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 01:04:58.602895 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 01:04:58.603001 15468 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0919b59b3b404f078540f5ed8920f80c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38023 } }
I20260811 01:04:58.604019 15470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0919b59b3b404f078540f5ed8920f80c. Latest consensus state: current_term: 1 leader_uuid: "0919b59b3b404f078540f5ed8920f80c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0919b59b3b404f078540f5ed8920f80c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38023 } } }
I20260811 01:04:58.604017 15469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0919b59b3b404f078540f5ed8920f80c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0919b59b3b404f078540f5ed8920f80c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38023 } } }
I20260811 01:04:58.604149 15470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [sys.catalog]: This master's current role is: LEADER
I20260811 01:04:58.604163 15469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c [sys.catalog]: This master's current role is: LEADER
W20260811 01:04:58.605360 15491 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:04:58.605410 15491 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:04:58.605551 15492 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:04:58.605746 15492 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:04:58.607511 15492 catalog_manager.cc:1347] Generated new cluster ID: 068efb13ec8347a49f932446e42df5bb
I20260811 01:04:58.607558 15492 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:04:58.620220 15492 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:04:58.620569 15492 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:04:58.635354 15492 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0919b59b3b404f078540f5ed8920f80c: Generated new TSK 0
I20260811 01:04:58.635619 15492 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:04:58.648938 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 15342
2026-08-11T01:04:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1532 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:04:58 dist-test-slave-42z9 krb5kdc[15500](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:04:58 dist-test-slave-42z9 krb5kdc[15500](info): set up 2 sockets
Aug 11 01:04:58 dist-test-slave-42z9 krb5kdc[15500](info): commencing operation
krb5kdc: starting...
W20260811 01:04:59.855605 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:04:59 dist-test-slave-42z9 krb5kdc[15500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:04:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:04:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:04:59.997429 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39385
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39385
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:05:00.086864 15521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:00.087143 15521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:00.087183 15521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:00.088546 15521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:00.088608 15521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:00.088629 15521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:00.088644 15521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:00.088660 15521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:00.090854 15521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39385
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:00.091358 15521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:00.091699 15521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:00.097699 15535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:00.097718 15529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:00.097869 15521 server_base.cc:1034] running on GCE node
W20260811 01:05:00.097699 15531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:00.098219 15521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:00.098569 15521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:00.099777 15521 hybrid_clock.cc:648] HybridClock initialized: now 1786410300099757 us; error 48 us; skew 500 ppm
Aug 11 01:05:00 dist-test-slave-42z9 krb5kdc[15500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410300, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:00.103053 15521 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:05:00.103564 15521 webserver.cc:460] Webserver started at http://127.0.0.1:46411/ using document root <none> and password file <none>
I20260811 01:05:00.103768 15521 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:00.103811 15521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:00.103924 15521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:00.105059 15521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "f34724994bba4d47ba215b6e56f32f8d"
format_stamp: "Formatted at 2026-08-11 01:05:00 on dist-test-slave-42z9"
server_key: "8ec62e9c4b4cd1d37e8bfc245e99cbc0"
server_key_iv: "176c9309e481f61796aa920b696e8632"
server_key_version: "encryptionkey@0"
I20260811 01:05:00.105417 15521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "f34724994bba4d47ba215b6e56f32f8d"
format_stamp: "Formatted at 2026-08-11 01:05:00 on dist-test-slave-42z9"
server_key: "8ec62e9c4b4cd1d37e8bfc245e99cbc0"
server_key_iv: "176c9309e481f61796aa920b696e8632"
server_key_version: "encryptionkey@0"
I20260811 01:05:00.106976 15521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:00.107978 15549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:00.108237 15521 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:00.108338 15521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "f34724994bba4d47ba215b6e56f32f8d"
format_stamp: "Formatted at 2026-08-11 01:05:00 on dist-test-slave-42z9"
server_key: "8ec62e9c4b4cd1d37e8bfc245e99cbc0"
server_key_iv: "176c9309e481f61796aa920b696e8632"
server_key_version: "encryptionkey@0"
I20260811 01:05:00.108428 15521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:00.135080 15521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:00.138561 15521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:00.138751 15521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:00.143491 15521 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39385
I20260811 01:05:00.143546 15642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39385 every 8 connection(s)
I20260811 01:05:00.143918 15521 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:05:00.144932 15644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:00.146067 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 15521
I20260811 01:05:00.146341 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:05:00.146629 13434 external_mini_cluster.cc:1428] Setting key a4ec04b66166fbf954a1d60e74b3e1ea
I20260811 01:05:00.148658 15644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d: Bootstrap starting.
I20260811 01:05:00.149318 15644 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:00.149643 15644 log.cc:824] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:00.150386 15644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d: No bootstrap required, opened a new log
I20260811 01:05:00.152374 15644 raft_consensus.cc:348] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34724994bba4d47ba215b6e56f32f8d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39385 } }
I20260811 01:05:00.152537 15644 raft_consensus.cc:374] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:05:00.152572 15644 raft_consensus.cc:729] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f34724994bba4d47ba215b6e56f32f8d, State: Initialized, Role: FOLLOWER
I20260811 01:05:00.152699 15644 consensus_queue.cc:260] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34724994bba4d47ba215b6e56f32f8d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39385 } }
I20260811 01:05:00.152778 15644 raft_consensus.cc:388] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:05:00.152834 15644 raft_consensus.cc:482] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:05:00.152889 15644 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [term 0 FOLLOWER]: Advancing to term 1
Aug 11 01:05:00 dist-test-slave-42z9 krb5kdc[15500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 01:05:00.153656 15644 raft_consensus.cc:504] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34724994bba4d47ba215b6e56f32f8d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39385 } }
I20260811 01:05:00.153767 15644 leader_election.cc:302] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f34724994bba4d47ba215b6e56f32f8d; no voters:
I20260811 01:05:00.153980 15644 leader_election.cc:288] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:05:00.154024 15650 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:05:00.154192 15650 raft_consensus.cc:686] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [term 1 LEADER]: Becoming Leader. State: Replica: f34724994bba4d47ba215b6e56f32f8d, State: Running, Role: LEADER
I20260811 01:05:00.154300 15644 sys_catalog.cc:564] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:00.154382 15650 consensus_queue.cc:237] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34724994bba4d47ba215b6e56f32f8d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39385 } }
I20260811 01:05:00.154796 15652 sys_catalog.cc:455] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f34724994bba4d47ba215b6e56f32f8d. Latest consensus state: current_term: 1 leader_uuid: "f34724994bba4d47ba215b6e56f32f8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34724994bba4d47ba215b6e56f32f8d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39385 } } }
I20260811 01:05:00.154946 15652 sys_catalog.cc:458] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:00.155213 15661 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:05:00.156275 15661 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:05:00.156119 15651 sys_catalog.cc:455] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f34724994bba4d47ba215b6e56f32f8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f34724994bba4d47ba215b6e56f32f8d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39385 } } }
I20260811 01:05:00.157626 15651 sys_catalog.cc:458] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:00.158030 15647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:00.147227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:46835 (local address 127.0.0.1:39385)
0811 01:05:00.147430 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:00.147438 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:00.147465 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:05:00.147929 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:00.147935 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:00.147987 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:00.148124 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:00.148822 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:00.149806 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:00.150655 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:00.151092 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:00.151197 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:00.153704 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:00.153708 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:00.153708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:00.153721 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:00.155743 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:00.156233 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:00.156237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:00.156237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:00.156358 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:00.156708 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:00.156709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:00.156710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:00.157048 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:00.157217 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:00.157513 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 01:05:00.157626 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":108,"threads_started":1}
I20260811 01:05:00.158397 15661 catalog_manager.cc:1347] Generated new cluster ID: 418214243f87495993dafc9b9cb96252
I20260811 01:05:00.158452 15661 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:05:00.159039 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:05:00.168493 15647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:00.160784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:48819 (local address 127.0.0.1:39385)
0811 01:05:00.160825 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:00.160827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:00.160836 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:05:00.160887 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:00.160888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:00.160898 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:00.160947 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:00.161678 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:00.162463 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:00.163538 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:00.163861 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:00.163915 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:00.165495 (+ 1580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:00.165497 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:00.165497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:00.165505 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:00.167058 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:00.167530 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:00.167531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:00.167532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:00.167596 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:00.167808 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:00.167809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:00.167809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:00.167941 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:00.168064 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:00.168197 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 01:05:00.168267 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 01:05:00.169032 15661 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:05:00.169786 15661 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:05:00.179659 15661 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f34724994bba4d47ba215b6e56f32f8d: Generated new TSK 0
I20260811 01:05:00.179912 15661 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:05:00.189008 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 15521
W20260811 01:05:00.210691 15496 connection.cc:535] client connection to 127.0.0.1:39385 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39385): Connection reset by peer (error 104)
2026-08-11T01:05:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1536 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:05:00 dist-test-slave-42z9 krb5kdc[15693](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:05:00 dist-test-slave-42z9 krb5kdc[15693](info): set up 2 sockets
Aug 11 01:05:00 dist-test-slave-42z9 krb5kdc[15693](info): commencing operation
krb5kdc: starting...
W20260811 01:05:01.414268 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:05:01 dist-test-slave-42z9 krb5kdc[15693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:05:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:05:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:05:01.553961 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33257
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:05:01.641808 15716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:01.642071 15716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:01.642112 15716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:01.643399 15716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:01.643457 15716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:01.643476 15716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:01.643492 15716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:01.643508 15716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:01.645242 15716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:01.645589 15716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:01.645846 15716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:01.651762 15723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:01.651844 15726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:01.651854 15716 server_base.cc:1034] running on GCE node
W20260811 01:05:01.652137 15729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:01.652451 15716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:01.652814 15716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:01.654016 15716 hybrid_clock.cc:648] HybridClock initialized: now 1786410301653991 us; error 41 us; skew 500 ppm
Aug 11 01:05:01 dist-test-slave-42z9 krb5kdc[15693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410301, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:01.656874 15716 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:05:01.657420 15716 webserver.cc:460] Webserver started at http://127.0.0.1:42173/ using document root <none> and password file <none>
I20260811 01:05:01.657727 15716 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:01.657783 15716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:01.657893 15716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:01.659060 15716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "e4936ccddff64f95a4180b3385aaa4e5"
format_stamp: "Formatted at 2026-08-11 01:05:01 on dist-test-slave-42z9"
server_key: "f9d356b8281590c84c0e4b8f14fbf7f0"
server_key_iv: "554b8dd279f114ffe75ae27dcaebc00a"
server_key_version: "encryptionkey@0"
I20260811 01:05:01.659432 15716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "e4936ccddff64f95a4180b3385aaa4e5"
format_stamp: "Formatted at 2026-08-11 01:05:01 on dist-test-slave-42z9"
server_key: "f9d356b8281590c84c0e4b8f14fbf7f0"
server_key_iv: "554b8dd279f114ffe75ae27dcaebc00a"
server_key_version: "encryptionkey@0"
I20260811 01:05:01.660889 15716 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:05:01.661761 15743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:01.662045 15716 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:01.662212 15716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "e4936ccddff64f95a4180b3385aaa4e5"
format_stamp: "Formatted at 2026-08-11 01:05:01 on dist-test-slave-42z9"
server_key: "f9d356b8281590c84c0e4b8f14fbf7f0"
server_key_iv: "554b8dd279f114ffe75ae27dcaebc00a"
server_key_version: "encryptionkey@0"
I20260811 01:05:01.662320 15716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:01.681546 15716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:01.684602 15716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:01.684787 15716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:01.689108 15716 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33257
I20260811 01:05:01.689162 15826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33257 every 8 connection(s)
I20260811 01:05:01.689572 15716 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:05:01.690574 15827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:01.690982 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 15716
I20260811 01:05:01.691123 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:05:01.691365 13434 external_mini_cluster.cc:1428] Setting key d3f97c92023fbae2662461a53ed1ddda
I20260811 01:05:01.694058 15827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5: Bootstrap starting.
I20260811 01:05:01.694878 15827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:01.695212 15827 log.cc:824] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:01.695957 15827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5: No bootstrap required, opened a new log
I20260811 01:05:01.698232 15833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:01.692159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:41709 (local address 127.0.0.1:33257)
0811 01:05:01.692446 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:01.692459 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:01.692566 (+ 107us) server_negotiation.cc:407] Connection header received
0811 01:05:01.693105 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:01.693115 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:01.693189 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:01.693373 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:01.693683 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:01.695031 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:01.696014 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:01.696611 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:01.696738 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:01.697415 (+ 677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:01.697420 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:01.697421 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:01.697678 (+ 257us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:01.697719 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:01.697737 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:01.697841 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:01.697967 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 01:05:01.698000 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":125,"threads_started":1}
I20260811 01:05:01.698450 15827 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4936ccddff64f95a4180b3385aaa4e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33257 } }
I20260811 01:05:01.698596 15827 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:05:01.698618 15827 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4936ccddff64f95a4180b3385aaa4e5, State: Initialized, Role: FOLLOWER
I20260811 01:05:01.698747 15827 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4936ccddff64f95a4180b3385aaa4e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33257 } }
I20260811 01:05:01.698810 15827 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:05:01.698835 15827 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:05:01.698890 15827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:01.699460 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:05:01.699679 15827 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4936ccddff64f95a4180b3385aaa4e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33257 } }
I20260811 01:05:01.699783 15827 leader_election.cc:302] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4936ccddff64f95a4180b3385aaa4e5; no voters:
I20260811 01:05:01.699999 15827 leader_election.cc:288] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:05:01.700037 15837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:05:01.700206 15837 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [term 1 LEADER]: Becoming Leader. State: Replica: e4936ccddff64f95a4180b3385aaa4e5, State: Running, Role: LEADER
I20260811 01:05:01.700284 15827 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:01.700389 15837 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4936ccddff64f95a4180b3385aaa4e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33257 } }
I20260811 01:05:01.700779 15839 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4936ccddff64f95a4180b3385aaa4e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4936ccddff64f95a4180b3385aaa4e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33257 } } }
I20260811 01:05:01.700871 15839 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:01.700768 15837 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4936ccddff64f95a4180b3385aaa4e5. Latest consensus state: current_term: 1 leader_uuid: "e4936ccddff64f95a4180b3385aaa4e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4936ccddff64f95a4180b3385aaa4e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33257 } } }
I20260811 01:05:01.701149 15837 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5 [sys.catalog]: This master's current role is: LEADER
W20260811 01:05:01.702345 15870 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:05:01.702409 15870 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:05:01.702459 15856 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:05:01.702643 15856 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:05:01.704236 15856 catalog_manager.cc:1347] Generated new cluster ID: 117267195bc9451c8de470c27c2c430c
I20260811 01:05:01.704293 15856 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:05:01.706048 15833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:01.701001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:49675 (local address 127.0.0.1:33257)
0811 01:05:01.701040 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:01.701041 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:01.701244 (+ 203us) server_negotiation.cc:407] Connection header received
0811 01:05:01.701337 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:01.701338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:01.701350 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:01.701389 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:01.701651 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:01.702352 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:01.703343 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:01.703645 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:01.703724 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:01.705790 (+ 2066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:01.705792 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:01.705792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:01.705798 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:01.705816 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:01.705821 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:01.705883 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:01.705958 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 01:05:01.705971 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 01:05:01.725225 15856 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:05:01.725864 15856 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:05:01.731019 15856 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4936ccddff64f95a4180b3385aaa4e5: Generated new TSK 0
I20260811 01:05:01.731249 15856 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:05:01.738822 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 15716
W20260811 01:05:01.760572 15687 connection.cc:535] client connection to 127.0.0.1:33257 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33257): Connection reset by peer (error 104)
2026-08-11T01:05:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1549 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:05:01 dist-test-slave-42z9 krb5kdc[15881](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:05:01 dist-test-slave-42z9 krb5kdc[15881](info): set up 2 sockets
Aug 11 01:05:01 dist-test-slave-42z9 krb5kdc[15881](info): commencing operation
krb5kdc: starting...
W20260811 01:05:02.952226 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:05:03 dist-test-slave-42z9 krb5kdc[15881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:05:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:05:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:05:03.097651 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40157
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:05:03.194713 15908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:03.194996 15908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:03.195035 15908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:03.196342 15908 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:03.196405 15908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:03.196424 15908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:03.196441 15908 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:03.196455 15908 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:03.198231 15908 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15908
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:03.198560 15908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:03.198812 15908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:03.204572 15915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:03.204572 15919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:03.204890 15908 server_base.cc:1034] running on GCE node
W20260811 01:05:03.204572 15921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:03.205269 15908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:03.205659 15908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:03.206887 15908 hybrid_clock.cc:648] HybridClock initialized: now 1786410303206868 us; error 37 us; skew 500 ppm
Aug 11 01:05:03 dist-test-slave-42z9 krb5kdc[15881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410303, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:03.214787 15908 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:05:03.215552 15908 webserver.cc:460] Webserver started at http://127.0.0.1:46255/ using document root <none> and password file <none>
I20260811 01:05:03.215821 15908 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:03.215883 15908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:03.216044 15908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:03.217231 15908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "4c81d1ded953435eb60b9a20945c595a"
format_stamp: "Formatted at 2026-08-11 01:05:03 on dist-test-slave-42z9"
server_key: "18dcfc48a47efc9d06a8e7bc804e235d"
server_key_iv: "56c776eeee3cfaa87775663b203ffedc"
server_key_version: "encryptionkey@0"
I20260811 01:05:03.217648 15908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "4c81d1ded953435eb60b9a20945c595a"
format_stamp: "Formatted at 2026-08-11 01:05:03 on dist-test-slave-42z9"
server_key: "18dcfc48a47efc9d06a8e7bc804e235d"
server_key_iv: "56c776eeee3cfaa87775663b203ffedc"
server_key_version: "encryptionkey@0"
I20260811 01:05:03.219151 15908 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:03.220046 15939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:03.220453 15908 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:03.220645 15908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "4c81d1ded953435eb60b9a20945c595a"
format_stamp: "Formatted at 2026-08-11 01:05:03 on dist-test-slave-42z9"
server_key: "18dcfc48a47efc9d06a8e7bc804e235d"
server_key_iv: "56c776eeee3cfaa87775663b203ffedc"
server_key_version: "encryptionkey@0"
I20260811 01:05:03.220851 15908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:03.224571 15908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:03.227255 15908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:03.227428 15908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:03.231828 15908 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40157
I20260811 01:05:03.231873 16022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40157 every 8 connection(s)
I20260811 01:05:03.232235 15908 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:05:03.233896 16024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:03.235633 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 15908
I20260811 01:05:03.235785 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:05:03.236032 13434 external_mini_cluster.cc:1428] Setting key 32f6d6628e54d6b72c82cd96aa640977
I20260811 01:05:03.237587 16024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a: Bootstrap starting.
I20260811 01:05:03.238370 16024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:03.238680 16024 log.cc:824] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:03.238960 16030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:03.236690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:54167 (local address 127.0.0.1:40157)
0811 01:05:03.236889 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:03.236897 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:03.236925 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:05:03.237559 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:03.237569 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:03.237602 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:03.237763 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:03.238527 (+ 764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:03.238530 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:03.238530 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:03.238534 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:03.238576 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:03.238587 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:03.238676 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:03.238713 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 01:05:03.238761 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":89,"threads_started":1}
I20260811 01:05:03.239482 16024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a: No bootstrap required, opened a new log
I20260811 01:05:03.240015 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:05:03.241716 16024 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c81d1ded953435eb60b9a20945c595a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40157 } }
I20260811 01:05:03.241936 16024 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:05:03.241976 16024 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c81d1ded953435eb60b9a20945c595a, State: Initialized, Role: FOLLOWER
I20260811 01:05:03.242087 16024 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c81d1ded953435eb60b9a20945c595a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40157 } }
I20260811 01:05:03.242182 16024 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:05:03.242213 16024 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:05:03.242265 16024 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:03.242683 16030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:03.241434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:53229 (local address 127.0.0.1:40157)
0811 01:05:03.241542 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:03.241543 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:03.241572 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:05:03.241643 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:03.241644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:03.241648 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:03.241693 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:03.242435 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:03.242459 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:03.242459 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:03.242464 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:03.242482 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:03.242487 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:03.242536 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:03.242608 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 01:05:03.242619 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 01:05:03.243140 16024 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c81d1ded953435eb60b9a20945c595a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40157 } }
I20260811 01:05:03.243256 16024 leader_election.cc:302] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c81d1ded953435eb60b9a20945c595a; no voters:
I20260811 01:05:03.243435 16024 leader_election.cc:288] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:05:03.243479 16042 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:05:03.243625 16042 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [term 1 LEADER]: Becoming Leader. State: Replica: 4c81d1ded953435eb60b9a20945c595a, State: Running, Role: LEADER
I20260811 01:05:03.243750 16024 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:03.243774 16042 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c81d1ded953435eb60b9a20945c595a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40157 } }
I20260811 01:05:03.244163 16045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c81d1ded953435eb60b9a20945c595a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c81d1ded953435eb60b9a20945c595a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40157 } } }
I20260811 01:05:03.244278 16045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:03.244174 16047 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c81d1ded953435eb60b9a20945c595a. Latest consensus state: current_term: 1 leader_uuid: "4c81d1ded953435eb60b9a20945c595a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c81d1ded953435eb60b9a20945c595a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40157 } } }
I20260811 01:05:03.244517 16047 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:03.244861 16060 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:05:03.245399 16060 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:05:03.247040 16060 catalog_manager.cc:1347] Generated new cluster ID: e1accd619e944f08a81800d57ef38116
I20260811 01:05:03.247085 16060 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:05:03.259047 16060 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:05:03.259326 16060 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:05:03.268127 16060 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c81d1ded953435eb60b9a20945c595a: Generated new TSK 0
I20260811 01:05:03.268342 16060 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:05:03.276160 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 15908
2026-08-11T01:05:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1527 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:05:03 dist-test-slave-42z9 krb5kdc[16079](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:05:03 dist-test-slave-42z9 krb5kdc[16079](info): set up 2 sockets
Aug 11 01:05:03 dist-test-slave-42z9 krb5kdc[16079](info): commencing operation
krb5kdc: starting...
W20260811 01:05:04.477229 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:05:04 dist-test-slave-42z9 krb5kdc[16079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:05:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:05:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:05:04.617003 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43467
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43467
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:05:04.710361 16096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:04.710605 16096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:04.710644 16096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:04.711870 16096 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:04.711922 16096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:04.711941 16096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:04.711958 16096 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:04.711973 16096 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:04.713665 16096 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43467
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:04.713975 16096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:04.714218 16096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:04.719280 16112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:04.719368 16107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:04.719316 16108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:04.719662 16096 server_base.cc:1034] running on GCE node
I20260811 01:05:04.720108 16096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:04.720448 16096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:04.721588 16096 hybrid_clock.cc:648] HybridClock initialized: now 1786410304721572 us; error 31 us; skew 500 ppm
Aug 11 01:05:04 dist-test-slave-42z9 krb5kdc[16079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410304, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:04.724224 16096 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:05:04.724725 16096 webserver.cc:460] Webserver started at http://127.0.0.1:38613/ using document root <none> and password file <none>
I20260811 01:05:04.724968 16096 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:04.725020 16096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:04.725153 16096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:04.726312 16096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "47c26db81a91444e83813f66869f3d71"
format_stamp: "Formatted at 2026-08-11 01:05:04 on dist-test-slave-42z9"
server_key: "2568658c974d26c82d1c750c8850a5a0"
server_key_iv: "751412fe92b83e4026862ea86d615c3d"
server_key_version: "encryptionkey@0"
I20260811 01:05:04.726668 16096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "47c26db81a91444e83813f66869f3d71"
format_stamp: "Formatted at 2026-08-11 01:05:04 on dist-test-slave-42z9"
server_key: "2568658c974d26c82d1c750c8850a5a0"
server_key_iv: "751412fe92b83e4026862ea86d615c3d"
server_key_version: "encryptionkey@0"
I20260811 01:05:04.728207 16096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 01:05:04.729035 16124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:04.729198 16096 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:05:04.729290 16096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "47c26db81a91444e83813f66869f3d71"
format_stamp: "Formatted at 2026-08-11 01:05:04 on dist-test-slave-42z9"
server_key: "2568658c974d26c82d1c750c8850a5a0"
server_key_iv: "751412fe92b83e4026862ea86d615c3d"
server_key_version: "encryptionkey@0"
I20260811 01:05:04.729357 16096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:04.744433 16096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:04.746665 16096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:04.746846 16096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:04.751343 16096 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43467
I20260811 01:05:04.751385 16216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43467 every 8 connection(s)
I20260811 01:05:04.751781 16096 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:05:04.752802 16217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:04.755043 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 16096
I20260811 01:05:04.755157 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:05:04.755388 13434 external_mini_cluster.cc:1428] Setting key 0f424fa6bd670ce207365f26a27a8f8a
I20260811 01:05:04.755553 16217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71: Bootstrap starting.
I20260811 01:05:04.756340 16217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:04.756644 16217 log.cc:824] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:04.757593 16217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71: No bootstrap required, opened a new log
I20260811 01:05:04.761390 16217 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47c26db81a91444e83813f66869f3d71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43467 } }
I20260811 01:05:04.761641 16217 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:05:04.761682 16217 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c26db81a91444e83813f66869f3d71, State: Initialized, Role: FOLLOWER
I20260811 01:05:04.761849 16217 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47c26db81a91444e83813f66869f3d71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43467 } }
I20260811 01:05:04.761945 16217 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:05:04.761989 16217 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:05:04.762048 16217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:04.762847 16217 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47c26db81a91444e83813f66869f3d71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43467 } }
I20260811 01:05:04.762984 16217 leader_election.cc:302] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47c26db81a91444e83813f66869f3d71; no voters:
Aug 11 01:05:04 dist-test-slave-42z9 krb5kdc[16079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 01:05:04.763185 16217 leader_election.cc:288] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:05:04.763218 16224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:05:04.763384 16224 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [term 1 LEADER]: Becoming Leader. State: Replica: 47c26db81a91444e83813f66869f3d71, State: Running, Role: LEADER
I20260811 01:05:04.763516 16217 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:04.763556 16224 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47c26db81a91444e83813f66869f3d71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43467 } }
I20260811 01:05:04.764050 16226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47c26db81a91444e83813f66869f3d71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47c26db81a91444e83813f66869f3d71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43467 } } }
I20260811 01:05:04.763926 16224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47c26db81a91444e83813f66869f3d71. Latest consensus state: current_term: 1 leader_uuid: "47c26db81a91444e83813f66869f3d71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47c26db81a91444e83813f66869f3d71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43467 } } }
I20260811 01:05:04.764348 16224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:04.764575 16226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71 [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:04.764619 16237 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:05:04.765218 16237 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:05:04.767642 16222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:04.755975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:60819 (local address 127.0.0.1:43467)
0811 01:05:04.756170 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:04.756178 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:04.756206 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:05:04.756699 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:04.756708 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:04.756777 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:04.756940 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:04.757754 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:04.759083 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:04.760181 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:04.760636 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:04.760739 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:04.763650 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:04.763655 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:04.763656 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:04.763670 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:04.765841 (+ 2171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:04.766334 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:04.766337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:04.766338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:04.766446 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:04.766726 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:04.766728 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:04.766728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:04.767055 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:04.767224 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:04.767321 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 01:05:04.767432 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
I20260811 01:05:04.768726 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:05:04.769870 16237 catalog_manager.cc:1347] Generated new cluster ID: 3d3fc9731b4b4d309ef8c08e585d649e
I20260811 01:05:04.769927 16237 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:05:04.779739 16237 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:05:04.780725 16237 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:05:04.782608 16222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:04.774092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:33939 (local address 127.0.0.1:43467)
0811 01:05:04.774131 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:04.774133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:04.774382 (+ 249us) server_negotiation.cc:407] Connection header received
0811 01:05:04.774454 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:04.774456 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:04.774473 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:04.774533 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:04.775263 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:04.776129 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:04.777288 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:04.777761 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:04.777846 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:04.779714 (+ 1868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:04.779716 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:04.779716 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:04.779725 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:04.781323 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:04.781804 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:04.781806 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:04.781806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:04.781862 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:04.782065 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:04.782066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:04.782066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:04.782187 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:04.782297 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:04.782434 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 01:05:04.782502 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 01:05:04.786981 16237 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47c26db81a91444e83813f66869f3d71: Generated new TSK 0
I20260811 01:05:04.787199 16237 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:05:04.791152 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 16096
W20260811 01:05:04.827693 16076 connection.cc:535] client connection to 127.0.0.1:43467 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43467): Connection reset by peer (error 104)
2026-08-11T01:05:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1539 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:05:04 dist-test-slave-42z9 krb5kdc[16269](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:05:04 dist-test-slave-42z9 krb5kdc[16269](info): set up 2 sockets
Aug 11 01:05:04 dist-test-slave-42z9 krb5kdc[16269](info): commencing operation
krb5kdc: starting...
W20260811 01:05:06.023379 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:05:06 dist-test-slave-42z9 krb5kdc[16269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:05:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:05:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:05:06.165017 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37141
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:05:06.261567 16291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:06.261817 16291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:06.261845 16291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:06.263278 16291 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:06.263356 16291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:06.263371 16291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:06.263382 16291 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:06.263394 16291 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:06.265220 16291 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37141
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:06.265563 16291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:06.265832 16291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:06.271303 16303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:06.271306 16305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:06.271600 16291 server_base.cc:1034] running on GCE node
W20260811 01:05:06.271306 16307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:06.271926 16291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:06.272264 16291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:06.273532 16291 hybrid_clock.cc:648] HybridClock initialized: now 1786410306273498 us; error 34 us; skew 500 ppm
Aug 11 01:05:06 dist-test-slave-42z9 krb5kdc[16269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410306, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:06.277137 16291 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:05:06.277806 16291 webserver.cc:460] Webserver started at http://127.0.0.1:34845/ using document root <none> and password file <none>
I20260811 01:05:06.278083 16291 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:06.278141 16291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:06.278290 16291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:06.279598 16291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "abd6b139011841698841dc535467cef9"
format_stamp: "Formatted at 2026-08-11 01:05:06 on dist-test-slave-42z9"
server_key: "9f1dd12daf46d57465bcdf777a85247f"
server_key_iv: "053c69a01b5b01b5b5f0b99f24e0ab31"
server_key_version: "encryptionkey@0"
I20260811 01:05:06.279980 16291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "abd6b139011841698841dc535467cef9"
format_stamp: "Formatted at 2026-08-11 01:05:06 on dist-test-slave-42z9"
server_key: "9f1dd12daf46d57465bcdf777a85247f"
server_key_iv: "053c69a01b5b01b5b5f0b99f24e0ab31"
server_key_version: "encryptionkey@0"
I20260811 01:05:06.282012 16291 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 01:05:06.283077 16324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:06.283419 16291 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:06.283563 16291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "abd6b139011841698841dc535467cef9"
format_stamp: "Formatted at 2026-08-11 01:05:06 on dist-test-slave-42z9"
server_key: "9f1dd12daf46d57465bcdf777a85247f"
server_key_iv: "053c69a01b5b01b5b5f0b99f24e0ab31"
server_key_version: "encryptionkey@0"
I20260811 01:05:06.283648 16291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:06.298081 16291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:06.300537 16291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:06.300700 16291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:06.305045 16291 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37141
I20260811 01:05:06.305091 16415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37141 every 8 connection(s)
I20260811 01:05:06.305528 16291 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:05:06.306605 16416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:06.309166 16416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9: Bootstrap starting.
I20260811 01:05:06.309850 16416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:06.310132 16416 log.cc:824] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:06.310986 16416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9: No bootstrap required, opened a new log
I20260811 01:05:06.312271 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 16291
I20260811 01:05:06.312412 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:05:06.312605 13434 external_mini_cluster.cc:1428] Setting key b537fb07856cff5e4f96f55d50af0e55
I20260811 01:05:06.312934 16416 raft_consensus.cc:348] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abd6b139011841698841dc535467cef9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37141 } }
I20260811 01:05:06.313160 16416 raft_consensus.cc:374] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:05:06.313238 16416 raft_consensus.cc:729] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd6b139011841698841dc535467cef9, State: Initialized, Role: FOLLOWER
I20260811 01:05:06.313401 16416 consensus_queue.cc:260] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abd6b139011841698841dc535467cef9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37141 } }
I20260811 01:05:06.313541 16416 raft_consensus.cc:388] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:05:06.313584 16416 raft_consensus.cc:482] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:05:06.313629 16416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:06.315090 16416 raft_consensus.cc:504] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abd6b139011841698841dc535467cef9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37141 } }
I20260811 01:05:06.315228 16416 leader_election.cc:302] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abd6b139011841698841dc535467cef9; no voters:
I20260811 01:05:06.315410 16416 leader_election.cc:288] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:05:06.315554 16424 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:05:06.315804 16416 sys_catalog.cc:564] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:06.315912 16424 raft_consensus.cc:686] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [term 1 LEADER]: Becoming Leader. State: Replica: abd6b139011841698841dc535467cef9, State: Running, Role: LEADER
I20260811 01:05:06.316095 16424 consensus_queue.cc:237] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abd6b139011841698841dc535467cef9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37141 } }
I20260811 01:05:06.317070 16426 sys_catalog.cc:455] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abd6b139011841698841dc535467cef9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abd6b139011841698841dc535467cef9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37141 } } }
I20260811 01:05:06.317211 16426 sys_catalog.cc:458] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:06.317068 16427 sys_catalog.cc:455] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abd6b139011841698841dc535467cef9. Latest consensus state: current_term: 1 leader_uuid: "abd6b139011841698841dc535467cef9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abd6b139011841698841dc535467cef9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37141 } } }
I20260811 01:05:06.317520 16427 sys_catalog.cc:458] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9 [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:06.317734 16442 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:05:06.319202 16442 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:05:06.319487 16423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:06.313201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:46101 (local address 127.0.0.1:37141)
0811 01:05:06.313414 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:06.313425 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:06.313489 (+ 64us) server_negotiation.cc:407] Connection header received
0811 01:05:06.313618 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:06.313626 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:06.313692 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:06.313851 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:06.314016 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:06.315416 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:06.316579 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:06.317190 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:06.317305 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:06.318456 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:06.318463 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:06.318463 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:06.318755 (+ 292us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:06.318817 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:06.318836 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:06.318936 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:06.319134 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 01:05:06.319177 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":114,"threads_started":1}
I20260811 01:05:06.320964 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:05:06.321920 16442 catalog_manager.cc:1347] Generated new cluster ID: 83450c00e20c472b8b244ac31fd97479
I20260811 01:05:06.321985 16442 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:05:06.329361 16442 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:05:06.330202 16442 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:05:06.332890 16423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:06.323075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:48603 (local address 127.0.0.1:37141)
0811 01:05:06.323145 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:06.323148 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:06.329236 (+ 6088us) server_negotiation.cc:407] Connection header received
0811 01:05:06.329304 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:06.329305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:06.329330 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:06.329378 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:06.329605 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:06.330115 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:06.330895 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:06.331283 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:06.331423 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:06.332401 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:06.332403 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:06.332404 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:06.332412 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:06.332435 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:06.332440 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:06.332492 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:06.332753 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 01:05:06.332777 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 01:05:06.343868 16442 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abd6b139011841698841dc535467cef9: Generated new TSK 0
I20260811 01:05:06.344111 16442 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:05:06.346432 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 16291
W20260811 01:05:06.367523 16264 connection.cc:535] client connection to 127.0.0.1:37141 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37141): Connection reset by peer (error 104)
2026-08-11T01:05:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1540 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:05:06 dist-test-slave-42z9 krb5kdc[16470](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:05:06 dist-test-slave-42z9 krb5kdc[16470](info): set up 2 sockets
Aug 11 01:05:06 dist-test-slave-42z9 krb5kdc[16470](info): commencing operation
krb5kdc: starting...
W20260811 01:05:07.570945 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:05:07 dist-test-slave-42z9 krb5kdc[16470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:05:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:05:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:05:07.705839 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46483
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:05:07.794430 16491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:07.794678 16491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:07.794718 16491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:07.795944 16491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:07.795996 16491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:07.796015 16491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:07.796031 16491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:07.796047 16491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:07.797734 16491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46483
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:07.798015 16491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:07.798250 16491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:07.803308 16501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:07.803324 16503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:07.803318 16508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:07.803372 16491 server_base.cc:1034] running on GCE node
I20260811 01:05:07.803748 16491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:07.804054 16491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:07.805236 16491 hybrid_clock.cc:648] HybridClock initialized: now 1786410307805222 us; error 26 us; skew 500 ppm
Aug 11 01:05:07 dist-test-slave-42z9 krb5kdc[16470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410307, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:07.807896 16491 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:05:07.808403 16491 webserver.cc:460] Webserver started at http://127.0.0.1:45721/ using document root <none> and password file <none>
I20260811 01:05:07.808621 16491 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:07.808671 16491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:07.808812 16491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:07.809998 16491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "b05b9580e87a418da2553a990e867b4c"
format_stamp: "Formatted at 2026-08-11 01:05:07 on dist-test-slave-42z9"
server_key: "1db72fb7676ade19e55e2f1238cb6891"
server_key_iv: "76b8c1a374cdbf0e01ae9b859234b0f5"
server_key_version: "encryptionkey@0"
I20260811 01:05:07.810374 16491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "b05b9580e87a418da2553a990e867b4c"
format_stamp: "Formatted at 2026-08-11 01:05:07 on dist-test-slave-42z9"
server_key: "1db72fb7676ade19e55e2f1238cb6891"
server_key_iv: "76b8c1a374cdbf0e01ae9b859234b0f5"
server_key_version: "encryptionkey@0"
I20260811 01:05:07.812163 16491 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260811 01:05:07.813360 16517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:07.813753 16491 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:07.813871 16491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "b05b9580e87a418da2553a990e867b4c"
format_stamp: "Formatted at 2026-08-11 01:05:07 on dist-test-slave-42z9"
server_key: "1db72fb7676ade19e55e2f1238cb6891"
server_key_iv: "76b8c1a374cdbf0e01ae9b859234b0f5"
server_key_version: "encryptionkey@0"
I20260811 01:05:07.813961 16491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:07.817874 16491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:07.820842 16491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:07.821007 16491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:07.825407 16491 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46483
I20260811 01:05:07.825508 16597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46483 every 8 connection(s)
I20260811 01:05:07.825872 16491 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:05:07.826922 16600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:07.829252 16600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c: Bootstrap starting.
I20260811 01:05:07.829926 16600 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:07.830185 16600 log.cc:824] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:07.830940 16600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c: No bootstrap required, opened a new log
I20260811 01:05:07.832144 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 16491
I20260811 01:05:07.832279 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:05:07.832681 13434 external_mini_cluster.cc:1428] Setting key 379d059d4d40f433cf74053812e142bb
I20260811 01:05:07.833266 16600 raft_consensus.cc:348] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b05b9580e87a418da2553a990e867b4c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46483 } }
I20260811 01:05:07.833541 16600 raft_consensus.cc:374] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:05:07.833587 16600 raft_consensus.cc:729] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b05b9580e87a418da2553a990e867b4c, State: Initialized, Role: FOLLOWER
I20260811 01:05:07.833806 16600 consensus_queue.cc:260] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b05b9580e87a418da2553a990e867b4c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46483 } }
I20260811 01:05:07.833894 16600 raft_consensus.cc:388] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:05:07.833921 16600 raft_consensus.cc:482] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:05:07.833957 16600 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:07.835105 16600 raft_consensus.cc:504] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b05b9580e87a418da2553a990e867b4c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46483 } }
I20260811 01:05:07.835233 16600 leader_election.cc:302] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b05b9580e87a418da2553a990e867b4c; no voters:
I20260811 01:05:07.835422 16600 leader_election.cc:288] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:05:07.835466 16611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:05:07.835613 16611 raft_consensus.cc:686] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [term 1 LEADER]: Becoming Leader. State: Replica: b05b9580e87a418da2553a990e867b4c, State: Running, Role: LEADER
I20260811 01:05:07.835757 16600 sys_catalog.cc:564] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:07.835758 16611 consensus_queue.cc:237] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b05b9580e87a418da2553a990e867b4c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46483 } }
I20260811 01:05:07.836210 16609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:07.833594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:50901 (local address 127.0.0.1:46483)
0811 01:05:07.833837 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:07.833850 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:07.833898 (+ 48us) server_negotiation.cc:407] Connection header received
0811 01:05:07.834095 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:07.834103 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:07.834218 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:07.834444 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:07.835229 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:07.835233 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:07.835234 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:07.835239 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:07.835306 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:07.835322 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:07.835408 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:07.835450 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 01:05:07.835503 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":108,"threads_started":1}
I20260811 01:05:07.836760 16615 sys_catalog.cc:455] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b05b9580e87a418da2553a990e867b4c. Latest consensus state: current_term: 1 leader_uuid: "b05b9580e87a418da2553a990e867b4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b05b9580e87a418da2553a990e867b4c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46483 } } }
I20260811 01:05:07.836967 16612 sys_catalog.cc:455] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b05b9580e87a418da2553a990e867b4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b05b9580e87a418da2553a990e867b4c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46483 } } }
I20260811 01:05:07.837102 16612 sys_catalog.cc:458] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:07.836974 16615 sys_catalog.cc:458] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:07.837755 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 01:05:07.838135 16630 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:05:07.838526 16630 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:05:07.838639 16628 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:05:07.838861 16628 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:05:07.840670 16628 catalog_manager.cc:1347] Generated new cluster ID: 0c15c836b59c48da88c04c10ab12fe90
I20260811 01:05:07.840731 16628 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:05:07.850775 16609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:07.841933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:59475 (local address 127.0.0.1:46483)
0811 01:05:07.845584 (+ 3651us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:07.845586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:07.849768 (+ 4182us) server_negotiation.cc:407] Connection header received
0811 01:05:07.849847 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:07.849849 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:07.849858 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:07.849909 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:07.850540 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:07.850541 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:07.850542 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:07.850546 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:07.850564 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:07.850568 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:07.850623 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:07.850673 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 01:05:07.850687 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3616}
I20260811 01:05:07.890905 16628 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:05:07.891098 16628 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:05:07.899070 16628 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b05b9580e87a418da2553a990e867b4c: Generated new TSK 0
I20260811 01:05:07.899266 16628 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:05:07.911130 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 16491
2026-08-11T01:05:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1553 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:05:07 dist-test-slave-42z9 krb5kdc[16649](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:05:07 dist-test-slave-42z9 krb5kdc[16649](info): set up 2 sockets
Aug 11 01:05:07 dist-test-slave-42z9 krb5kdc[16649](info): commencing operation
krb5kdc: starting...
W20260811 01:05:09.128473 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:05:09 dist-test-slave-42z9 krb5kdc[16649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410309, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:05:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:05:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:05:09.270543 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:32995
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:32995
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:05:09.363374 16680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:09.363626 16680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:09.363660 16680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:09.364920 16680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:09.364975 16680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:09.364995 16680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:09.365010 16680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:09.365026 16680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:09.366652 16680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:32995
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:32995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:09.366925 16680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:09.367153 16680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:09.372283 16702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:09.372285 16696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:09.372289 16698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:09.372605 16680 server_base.cc:1034] running on GCE node
I20260811 01:05:09.372880 16680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:09.373198 16680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:09.374394 16680 hybrid_clock.cc:648] HybridClock initialized: now 1786410309374347 us; error 57 us; skew 500 ppm
Aug 11 01:05:09 dist-test-slave-42z9 krb5kdc[16649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410309, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:09.381240 16680 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:05:09.381811 16680 webserver.cc:460] Webserver started at http://127.13.30.190:36921/ using document root <none> and password file <none>
I20260811 01:05:09.382040 16680 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:09.382085 16680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:09.382218 16680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:09.383360 16680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "763b10132e634c43b6b8b57abbb41684"
format_stamp: "Formatted at 2026-08-11 01:05:09 on dist-test-slave-42z9"
server_key: "7df513d78ce86142de4c568f455fb3eb"
server_key_iv: "4d1c36300352f93f65c256473da9ff43"
server_key_version: "encryptionkey@0"
I20260811 01:05:09.383737 16680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "763b10132e634c43b6b8b57abbb41684"
format_stamp: "Formatted at 2026-08-11 01:05:09 on dist-test-slave-42z9"
server_key: "7df513d78ce86142de4c568f455fb3eb"
server_key_iv: "4d1c36300352f93f65c256473da9ff43"
server_key_version: "encryptionkey@0"
I20260811 01:05:09.385214 16680 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:05:09.386157 16713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:09.386335 16680 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 01:05:09.386433 16680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "763b10132e634c43b6b8b57abbb41684"
format_stamp: "Formatted at 2026-08-11 01:05:09 on dist-test-slave-42z9"
server_key: "7df513d78ce86142de4c568f455fb3eb"
server_key_iv: "4d1c36300352f93f65c256473da9ff43"
server_key_version: "encryptionkey@0"
I20260811 01:05:09.386518 16680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:09.400053 16680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:09.403584 16680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:09.403735 16680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:09.408095 16680 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:32995
I20260811 01:05:09.408185 16808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:32995 every 8 connection(s)
I20260811 01:05:09.408525 16680 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:05:09.409530 16809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:09.412340 16809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684: Bootstrap starting.
I20260811 01:05:09.413003 16809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:09.413280 16809 log.cc:824] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:09.414496 16809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684: No bootstrap required, opened a new log
I20260811 01:05:09.416656 16809 raft_consensus.cc:348] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "763b10132e634c43b6b8b57abbb41684" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 32995 } }
I20260811 01:05:09.416862 16809 raft_consensus.cc:374] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:05:09.416886 16809 raft_consensus.cc:729] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 763b10132e634c43b6b8b57abbb41684, State: Initialized, Role: FOLLOWER
I20260811 01:05:09.417055 16809 consensus_queue.cc:260] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "763b10132e634c43b6b8b57abbb41684" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 32995 } }
I20260811 01:05:09.417138 16809 raft_consensus.cc:388] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:05:09.417164 16809 raft_consensus.cc:482] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:05:09.417197 16809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:09.417853 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 16680
I20260811 01:05:09.417973 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:05:09.418157 13434 external_mini_cluster.cc:1428] Setting key 57df39fda6c24b68f4667ca56f7599c1
I20260811 01:05:09.418771 16809 raft_consensus.cc:504] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "763b10132e634c43b6b8b57abbb41684" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 32995 } }
I20260811 01:05:09.418967 16809 leader_election.cc:302] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 763b10132e634c43b6b8b57abbb41684; no voters:
I20260811 01:05:09.419144 16809 leader_election.cc:288] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:05:09.419168 16815 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:05:09.419278 16815 raft_consensus.cc:686] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [term 1 LEADER]: Becoming Leader. State: Replica: 763b10132e634c43b6b8b57abbb41684, State: Running, Role: LEADER
I20260811 01:05:09.419449 16815 consensus_queue.cc:237] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "763b10132e634c43b6b8b57abbb41684" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 32995 } }
I20260811 01:05:09.419494 16809 sys_catalog.cc:564] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:09.419909 16815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 763b10132e634c43b6b8b57abbb41684. Latest consensus state: current_term: 1 leader_uuid: "763b10132e634c43b6b8b57abbb41684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "763b10132e634c43b6b8b57abbb41684" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 32995 } } }
I20260811 01:05:09.420015 16815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:09.420148 16819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "763b10132e634c43b6b8b57abbb41684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "763b10132e634c43b6b8b57abbb41684" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 32995 } } }
I20260811 01:05:09.420235 16819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684 [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:09.420436 16823 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:05:09.421099 16823 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:05:09.423758 16823 catalog_manager.cc:1347] Generated new cluster ID: 986c4fd28e6f4e92af10bc13f1b5b8e3
I20260811 01:05:09.423818 16823 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 01:05:09 dist-test-slave-42z9 krb5kdc[16649](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410309, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:05:09.431268 16814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:09.418696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58805 (local address 127.13.30.190:32995)
0811 01:05:09.418939 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:09.418951 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:09.418992 (+ 41us) server_negotiation.cc:407] Connection header received
0811 01:05:09.419140 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:09.419146 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:09.419206 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:09.419378 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:09.420430 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:09.422003 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:09.423068 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:09.423524 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:09.423609 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:09.426673 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:09.426678 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:09.426679 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:09.426696 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:09.429386 (+ 2690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:09.429922 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:09.429927 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:09.429927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:09.430064 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:09.430271 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:09.430272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:09.430272 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:09.430642 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:09.430832 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:09.430919 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 01:05:09.431032 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":118,"threads_started":1}
I20260811 01:05:09.432360 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:05:09.439038 16823 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:05:09.439769 16823 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:05:09.444432 16823 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 763b10132e634c43b6b8b57abbb41684: Generated new TSK 0
I20260811 01:05:09.444689 16823 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:05:09.445580 16814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:09.434036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36355 (local address 127.13.30.190:32995)
0811 01:05:09.434077 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:09.434079 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:09.437741 (+ 3662us) server_negotiation.cc:407] Connection header received
0811 01:05:09.437821 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:09.437829 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:09.437857 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:09.437928 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:09.438743 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:09.439468 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:09.440624 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:09.440991 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:09.441057 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:09.442637 (+ 1580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:09.442639 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:09.442639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:09.442648 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:09.444239 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:09.444676 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:09.444677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:09.444678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:09.444754 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:09.444987 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:09.444988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:09.444989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:09.445142 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:09.445255 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:09.445355 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 01:05:09.445424 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 01:05:09.447662 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 16680
W20260811 01:05:09.467703 16646 connection.cc:535] client connection to 127.13.30.190:32995 recv error: Network error: failed to read from TLS socket (remote: 127.13.30.190:32995): Connection reset by peer (error 104)
2026-08-11T01:05:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1546 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:05:09 dist-test-slave-42z9 krb5kdc[16853](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:05:09 dist-test-slave-42z9 krb5kdc[16853](info): set up 2 sockets
Aug 11 01:05:09 dist-test-slave-42z9 krb5kdc[16853](info): commencing operation
krb5kdc: starting...
W20260811 01:05:10.640450 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:05:10 dist-test-slave-42z9 krb5kdc[16853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:05:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:05:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:05:10.772608 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:42325
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:42575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:42325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:05:10.859851 16891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:10.860109 16891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:10.860144 16891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:10.861495 16891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:10.861552 16891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:10.861570 16891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:10.861586 16891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:10.861603 16891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:10.863298 16891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:42575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:42325
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:42325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:10.863603 16891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:10.863839 16891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:10.869351 16903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:10.869351 16902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:10.869598 16891 server_base.cc:1034] running on GCE node
W20260811 01:05:10.869386 16905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:10.869947 16891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:10.870266 16891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:10.871420 16891 hybrid_clock.cc:648] HybridClock initialized: now 1786410310871406 us; error 37 us; skew 500 ppm
Aug 11 01:05:10 dist-test-slave-42z9 krb5kdc[16853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410310, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:10.874640 16891 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:05:10.875190 16891 webserver.cc:460] Webserver started at http://127.13.30.190:34835/ using document root <none> and password file <none>
I20260811 01:05:10.875422 16891 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:10.875475 16891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:10.875609 16891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:10.876744 16891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "eb0ee653a03e49d09fbba69745b1804a"
format_stamp: "Formatted at 2026-08-11 01:05:10 on dist-test-slave-42z9"
server_key: "bc2d0cc30845ba889669c2d4b8a9d7fe"
server_key_iv: "0a3e0c7808170a8e3743db0d434fe7bc"
server_key_version: "encryptionkey@0"
I20260811 01:05:10.877101 16891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "eb0ee653a03e49d09fbba69745b1804a"
format_stamp: "Formatted at 2026-08-11 01:05:10 on dist-test-slave-42z9"
server_key: "bc2d0cc30845ba889669c2d4b8a9d7fe"
server_key_iv: "0a3e0c7808170a8e3743db0d434fe7bc"
server_key_version: "encryptionkey@0"
I20260811 01:05:10.878608 16891 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 01:05:10.879451 16918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:10.879745 16891 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:10.879841 16891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "eb0ee653a03e49d09fbba69745b1804a"
format_stamp: "Formatted at 2026-08-11 01:05:10 on dist-test-slave-42z9"
server_key: "bc2d0cc30845ba889669c2d4b8a9d7fe"
server_key_iv: "0a3e0c7808170a8e3743db0d434fe7bc"
server_key_version: "encryptionkey@0"
I20260811 01:05:10.879907 16891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:10.889407 16891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:10.892395 16891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:10.892839 16891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:10.897224 16891 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:42325
I20260811 01:05:10.897302 16997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:42325 every 8 connection(s)
I20260811 01:05:10.897691 16891 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:05:10.898712 16998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:10.899142 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 16891
I20260811 01:05:10.899248 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:05:10.899451 13434 external_mini_cluster.cc:1428] Setting key 960726e9226f90a2bc43e8fe9283fdd4
I20260811 01:05:10.902364 16998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a: Bootstrap starting.
I20260811 01:05:10.903147 16998 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:10.903445 16998 log.cc:824] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:10.904238 16998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a: No bootstrap required, opened a new log
I20260811 01:05:10.905841 17007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:10.900082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38599 (local address 127.13.30.190:42325)
0811 01:05:10.900369 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:10.900380 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:10.900416 (+ 36us) server_negotiation.cc:407] Connection header received
0811 01:05:10.901023 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:10.901033 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:10.901096 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:10.901259 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:10.901587 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:10.902924 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:10.903799 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:10.904263 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:10.904386 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:10.905125 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:10.905129 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:10.905129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:10.905301 (+ 172us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:10.905362 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:10.905375 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:10.905474 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:10.905596 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 01:05:10.905625 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":93,"threads_started":1}
I20260811 01:05:10.906661 16998 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb0ee653a03e49d09fbba69745b1804a" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42325 } }
I20260811 01:05:10.906836 16998 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:05:10.906877 16998 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0ee653a03e49d09fbba69745b1804a, State: Initialized, Role: FOLLOWER
I20260811 01:05:10.906901 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:05:10.907014 16998 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb0ee653a03e49d09fbba69745b1804a" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42325 } }
I20260811 01:05:10.907084 16998 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:05:10.907106 16998 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:05:10.907153 16998 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:10.907790 16998 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb0ee653a03e49d09fbba69745b1804a" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42325 } }
I20260811 01:05:10.907915 16998 leader_election.cc:302] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb0ee653a03e49d09fbba69745b1804a; no voters:
I20260811 01:05:10.908103 16998 leader_election.cc:288] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:05:10.908281 17016 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:05:10.908382 16998 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:10.908483 17016 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [term 1 LEADER]: Becoming Leader. State: Replica: eb0ee653a03e49d09fbba69745b1804a, State: Running, Role: LEADER
I20260811 01:05:10.908645 17016 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb0ee653a03e49d09fbba69745b1804a" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42325 } }
I20260811 01:05:10.909034 17024 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb0ee653a03e49d09fbba69745b1804a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb0ee653a03e49d09fbba69745b1804a" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42325 } } }
I20260811 01:05:10.909112 17024 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:10.909230 17024 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb0ee653a03e49d09fbba69745b1804a. Latest consensus state: current_term: 1 leader_uuid: "eb0ee653a03e49d09fbba69745b1804a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb0ee653a03e49d09fbba69745b1804a" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42325 } } }
I20260811 01:05:10.909269 17024 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:10.909503 17040 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:05:10.910703 17040 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:05:10.911684 17007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:10.908305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55211 (local address 127.13.30.190:42325)
0811 01:05:10.908352 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:10.908354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:10.908443 (+ 89us) server_negotiation.cc:407] Connection header received
0811 01:05:10.908571 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:10.908572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:10.908582 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:10.908610 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:10.908810 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:10.909550 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:10.910298 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:10.910577 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:10.910646 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:10.911401 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:10.911403 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:10.911403 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:10.911407 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:10.911423 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:10.911427 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:10.911478 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:10.911597 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 01:05:10.911609 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 01:05:10.912556 17040 catalog_manager.cc:1347] Generated new cluster ID: 94a221c43d0044e8a7e77d811aef7f85
I20260811 01:05:10.912611 17040 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:05:10.919745 17040 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:05:10.920490 17040 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:05:10.926465 17040 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb0ee653a03e49d09fbba69745b1804a: Generated new TSK 0
I20260811 01:05:10.926694 17040 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:05:10.928990 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 16891
W20260811 01:05:10.944350 16848 connection.cc:535] client connection to 127.13.30.190:42325 recv error: Network error: failed to read from TLS socket (remote: 127.13.30.190:42325): Connection reset by peer (error 104)
2026-08-11T01:05:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1477 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:05:11 dist-test-slave-42z9 krb5kdc[17055](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:05:11 dist-test-slave-42z9 krb5kdc[17055](info): set up 2 sockets
Aug 11 01:05:11 dist-test-slave-42z9 krb5kdc[17055](info): commencing operation
krb5kdc: starting...
W20260811 01:05:12.128332 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:05:12 dist-test-slave-42z9 krb5kdc[17055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:05:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:05:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:05:12.264448 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:32799
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:42065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:32799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:05:12.350301 17074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:12.350545 17074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:12.350581 17074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:12.351835 17074 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:12.351895 17074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:12.351917 17074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:12.351935 17074 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:12.351953 17074 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:12.354609 17074 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:42065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:32799
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:32799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:12.354971 17074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:12.355242 17074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:12.360430 17083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:12.360536 17087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:12.360496 17082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:12.360780 17074 server_base.cc:1034] running on GCE node
I20260811 01:05:12.361217 17074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:12.361651 17074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:12.362860 17074 hybrid_clock.cc:648] HybridClock initialized: now 1786410312362821 us; error 58 us; skew 500 ppm
Aug 11 01:05:12 dist-test-slave-42z9 krb5kdc[17055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410312, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:12.365660 17074 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:05:12.366191 17074 webserver.cc:460] Webserver started at http://127.13.30.190:42961/ using document root <none> and password file <none>
I20260811 01:05:12.366415 17074 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:12.366456 17074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:12.366559 17074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:12.367640 17074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "af23ce73ec7d4c0ebe511d96241c90d8"
format_stamp: "Formatted at 2026-08-11 01:05:12 on dist-test-slave-42z9"
server_key: "a0b33dcc43974f3ba5ffd9f5f58c8d94"
server_key_iv: "1911b678bb71646e2f9d4c78811e6d7b"
server_key_version: "encryptionkey@0"
I20260811 01:05:12.368009 17074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "af23ce73ec7d4c0ebe511d96241c90d8"
format_stamp: "Formatted at 2026-08-11 01:05:12 on dist-test-slave-42z9"
server_key: "a0b33dcc43974f3ba5ffd9f5f58c8d94"
server_key_iv: "1911b678bb71646e2f9d4c78811e6d7b"
server_key_version: "encryptionkey@0"
I20260811 01:05:12.369531 17074 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 01:05:12.370349 17104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:12.370553 17074 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:12.370645 17074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "af23ce73ec7d4c0ebe511d96241c90d8"
format_stamp: "Formatted at 2026-08-11 01:05:12 on dist-test-slave-42z9"
server_key: "a0b33dcc43974f3ba5ffd9f5f58c8d94"
server_key_iv: "1911b678bb71646e2f9d4c78811e6d7b"
server_key_version: "encryptionkey@0"
I20260811 01:05:12.370708 17074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:12.374195 17074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:12.376101 17074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:12.376219 17074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:12.380295 17074 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:32799
I20260811 01:05:12.380321 17189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:32799 every 8 connection(s)
I20260811 01:05:12.380687 17074 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:05:12.381839 17191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:12.384379 17191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8: Bootstrap starting.
I20260811 01:05:12.385047 17191 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:12.385430 17191 log.cc:824] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:12.387069 17191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8: No bootstrap required, opened a new log
I20260811 01:05:12.389240 17191 raft_consensus.cc:348] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af23ce73ec7d4c0ebe511d96241c90d8" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 32799 } }
I20260811 01:05:12.389410 17191 raft_consensus.cc:374] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:05:12.389432 17191 raft_consensus.cc:729] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af23ce73ec7d4c0ebe511d96241c90d8, State: Initialized, Role: FOLLOWER
I20260811 01:05:12.389605 17191 consensus_queue.cc:260] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af23ce73ec7d4c0ebe511d96241c90d8" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 32799 } }
I20260811 01:05:12.389673 17191 raft_consensus.cc:388] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:05:12.389698 17191 raft_consensus.cc:482] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:05:12.389730 17191 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:12.390713 17191 raft_consensus.cc:504] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af23ce73ec7d4c0ebe511d96241c90d8" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 32799 } }
I20260811 01:05:12.390820 17191 leader_election.cc:302] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af23ce73ec7d4c0ebe511d96241c90d8; no voters:
I20260811 01:05:12.391000 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 17074
I20260811 01:05:12.391037 17191 leader_election.cc:288] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:05:12.391095 17199 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:05:12.391129 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:05:12.391283 17199 raft_consensus.cc:686] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [term 1 LEADER]: Becoming Leader. State: Replica: af23ce73ec7d4c0ebe511d96241c90d8, State: Running, Role: LEADER
I20260811 01:05:12.391331 13434 external_mini_cluster.cc:1428] Setting key 8a9917e669bd65118fd5f3dfdfa6a7be
I20260811 01:05:12.391325 17191 sys_catalog.cc:564] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:12.391456 17199 consensus_queue.cc:237] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af23ce73ec7d4c0ebe511d96241c90d8" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 32799 } }
I20260811 01:05:12.391800 17199 sys_catalog.cc:455] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af23ce73ec7d4c0ebe511d96241c90d8. Latest consensus state: current_term: 1 leader_uuid: "af23ce73ec7d4c0ebe511d96241c90d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af23ce73ec7d4c0ebe511d96241c90d8" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 32799 } } }
I20260811 01:05:12.391932 17199 sys_catalog.cc:458] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:12.391935 17200 sys_catalog.cc:455] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af23ce73ec7d4c0ebe511d96241c90d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af23ce73ec7d4c0ebe511d96241c90d8" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 32799 } } }
I20260811 01:05:12.392143 17200 sys_catalog.cc:458] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8 [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:12.392215 17212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:05:12.392817 17212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:05:12.394554 17212 catalog_manager.cc:1347] Generated new cluster ID: f3b5b8c577d34406b0f23245bfb31e77
I20260811 01:05:12.394807 17208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:12.391881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55931 (local address 127.13.30.190:32799)
0811 01:05:12.392094 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:12.392105 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:12.392844 (+ 739us) server_negotiation.cc:407] Connection header received
0811 01:05:12.393068 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:12.393077 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:12.393109 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:12.393217 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:12.394312 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:12.394316 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:12.394316 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:12.394321 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:12.394364 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:12.394380 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:12.394413 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:12.394550 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 01:05:12.394596 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":95,"threads_started":1}
I20260811 01:05:12.394613 17212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:05:12.395746 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:05:12.398523 17208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:12.397322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58229 (local address 127.13.30.190:32799)
0811 01:05:12.397356 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:12.397357 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:12.397511 (+ 154us) server_negotiation.cc:407] Connection header received
0811 01:05:12.397603 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:12.397604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:12.397609 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:12.397634 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:12.398286 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:12.398287 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:12.398288 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:12.398291 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:12.398305 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:12.398309 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:12.398335 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:12.398417 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 01:05:12.398429 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 01:05:12.400957 17212 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:05:12.401134 17212 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:05:12.409871 17212 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af23ce73ec7d4c0ebe511d96241c90d8: Generated new TSK 0
I20260811 01:05:12.410099 17212 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:05:12.413038 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 17074
2026-08-11T01:05:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1496 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:05:12 dist-test-slave-42z9 krb5kdc[17239](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:05:12 dist-test-slave-42z9 krb5kdc[17239](info): set up 2 sockets
Aug 11 01:05:12 dist-test-slave-42z9 krb5kdc[17239](info): commencing operation
krb5kdc: starting...
W20260811 01:05:13.622082 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:05:13 dist-test-slave-42z9 krb5kdc[17239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:05:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:05:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:05:13.760991 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:41783
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:45259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:41783
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:05:13.849412 17267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:13.849695 17267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:13.849721 17267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:13.851020 17267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:13.851068 17267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:13.851082 17267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:13.851094 17267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:13.851104 17267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:13.852761 17267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:45259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:41783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:41783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:13.853010 17267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:13.853221 17267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:13.858775 17280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:13.858771 17278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:13.858770 17282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:13.859098 17267 server_base.cc:1034] running on GCE node
I20260811 01:05:13.859421 17267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:13.859772 17267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:13.860951 17267 hybrid_clock.cc:648] HybridClock initialized: now 1786410313860925 us; error 41 us; skew 500 ppm
Aug 11 01:05:13 dist-test-slave-42z9 krb5kdc[17239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410313, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:13.863794 17267 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:05:13.864291 17267 webserver.cc:460] Webserver started at http://127.13.30.190:35069/ using document root <none> and password file <none>
I20260811 01:05:13.864552 17267 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:13.864603 17267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:13.864737 17267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:13.865911 17267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "ec8bd5cea0504e36b64e29cc27dd646b"
format_stamp: "Formatted at 2026-08-11 01:05:13 on dist-test-slave-42z9"
server_key: "63e44719d2c254786f14001ede9f9424"
server_key_iv: "5883c4b65f6b01fd6fd181acd404f484"
server_key_version: "encryptionkey@0"
I20260811 01:05:13.866257 17267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "ec8bd5cea0504e36b64e29cc27dd646b"
format_stamp: "Formatted at 2026-08-11 01:05:13 on dist-test-slave-42z9"
server_key: "63e44719d2c254786f14001ede9f9424"
server_key_iv: "5883c4b65f6b01fd6fd181acd404f484"
server_key_version: "encryptionkey@0"
I20260811 01:05:13.867686 17267 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:05:13.868703 17293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:13.869069 17267 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:13.869179 17267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "ec8bd5cea0504e36b64e29cc27dd646b"
format_stamp: "Formatted at 2026-08-11 01:05:13 on dist-test-slave-42z9"
server_key: "63e44719d2c254786f14001ede9f9424"
server_key_iv: "5883c4b65f6b01fd6fd181acd404f484"
server_key_version: "encryptionkey@0"
I20260811 01:05:13.869261 17267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:13.900636 17267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:13.902688 17267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:13.902835 17267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:13.907197 17267 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:41783
I20260811 01:05:13.907248 17392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:41783 every 8 connection(s)
I20260811 01:05:13.907600 17267 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:05:13.908603 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 17267
I20260811 01:05:13.908726 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:05:13.908934 17395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:13.908959 13434 external_mini_cluster.cc:1428] Setting key 49ce6d33f8e87e52453e2a34f4b5be0e
I20260811 01:05:13.912268 17395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b: Bootstrap starting.
I20260811 01:05:13.913055 17395 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:13.913345 17395 log.cc:824] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:13.914119 17395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b: No bootstrap required, opened a new log
Aug 11 01:05:13 dist-test-slave-42z9 krb5kdc[17239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:05:13.916128 17395 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec8bd5cea0504e36b64e29cc27dd646b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41783 } }
I20260811 01:05:13.916339 17395 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:05:13.916383 17395 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8bd5cea0504e36b64e29cc27dd646b, State: Initialized, Role: FOLLOWER
I20260811 01:05:13.916525 17395 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec8bd5cea0504e36b64e29cc27dd646b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41783 } }
I20260811 01:05:13.916608 17395 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:05:13.916631 17395 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:05:13.916702 17395 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:13.917308 17395 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec8bd5cea0504e36b64e29cc27dd646b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41783 } }
I20260811 01:05:13.917399 17395 leader_election.cc:302] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec8bd5cea0504e36b64e29cc27dd646b; no voters:
I20260811 01:05:13.917606 17395 leader_election.cc:288] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:05:13.917652 17402 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:05:13.917768 17402 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [term 1 LEADER]: Becoming Leader. State: Replica: ec8bd5cea0504e36b64e29cc27dd646b, State: Running, Role: LEADER
I20260811 01:05:13.917851 17402 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec8bd5cea0504e36b64e29cc27dd646b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41783 } }
I20260811 01:05:13.917906 17395 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:13.918181 17402 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec8bd5cea0504e36b64e29cc27dd646b. Latest consensus state: current_term: 1 leader_uuid: "ec8bd5cea0504e36b64e29cc27dd646b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec8bd5cea0504e36b64e29cc27dd646b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41783 } } }
I20260811 01:05:13.918229 17404 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec8bd5cea0504e36b64e29cc27dd646b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec8bd5cea0504e36b64e29cc27dd646b" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 41783 } } }
I20260811 01:05:13.918249 17402 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:13.918327 17404 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:13.919199 17410 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:05:13.919749 17410 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:05:13.920477 17400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:13.909554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59213 (local address 127.13.30.190:41783)
0811 01:05:13.909707 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:13.909715 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:13.909741 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:05:13.910147 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:13.910154 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:13.910201 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:13.910313 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:13.911082 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:13.911995 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:13.913006 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:13.913662 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:13.913756 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:13.916596 (+ 2840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:13.916601 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:13.916601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:13.916617 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:13.918704 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:13.919157 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:13.919161 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:13.919161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:13.919275 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:13.919521 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:13.919522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:13.919522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:13.919764 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:13.919933 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:13.920116 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 01:05:13.920254 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":60,"threads_started":1}
I20260811 01:05:13.921473 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:05:13.921489 17410 catalog_manager.cc:1347] Generated new cluster ID: 123c26c1db524cb4ba82b5d944094122
I20260811 01:05:13.921535 17410 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:05:13.928537 17400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:13.922805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37923 (local address 127.13.30.190:41783)
0811 01:05:13.922844 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:13.922846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:13.922961 (+ 115us) server_negotiation.cc:407] Connection header received
0811 01:05:13.923009 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:13.923010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:13.923020 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:13.923061 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:13.923568 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:13.924064 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:13.924751 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:13.925000 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:13.925057 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:13.926212 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:13.926214 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:13.926214 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:13.926221 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:13.927464 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:13.927780 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:13.927781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:13.927782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:13.927844 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:13.928009 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:13.928010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:13.928010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:13.928126 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:13.928218 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:13.928345 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 01:05:13.928437 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 01:05:13.935498 17410 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:05:13.936049 17410 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:05:13.963534 17410 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec8bd5cea0504e36b64e29cc27dd646b: Generated new TSK 0
I20260811 01:05:13.963860 17410 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:05:13.966174 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 17267
2026-08-11T01:05:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1539 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:05:14 dist-test-slave-42z9 krb5kdc[17459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:05:14 dist-test-slave-42z9 krb5kdc[17459](info): set up 2 sockets
Aug 11 01:05:14 dist-test-slave-42z9 krb5kdc[17459](info): commencing operation
krb5kdc: starting...
W20260811 01:05:15.160562 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:05:15 dist-test-slave-42z9 krb5kdc[17459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:05:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:05:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:05:15.296978 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:36143
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:35391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:36143
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:05:15.385324 17477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:15.385617 17477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:15.385643 17477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:15.386986 17477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:15.387058 17477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:15.387071 17477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:15.387084 17477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:15.387094 17477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:15.388897 17477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:35391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:36143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:36143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:15.389223 17477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:15.389521 17477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:15.394768 17493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:15.394863 17486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:15.394899 17477 server_base.cc:1034] running on GCE node
W20260811 01:05:15.394863 17490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:15.395586 17477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:15.395936 17477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:15.397087 17477 hybrid_clock.cc:648] HybridClock initialized: now 1786410315397070 us; error 43 us; skew 500 ppm
Aug 11 01:05:15 dist-test-slave-42z9 krb5kdc[17459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410315, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:15.404598 17477 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:05:15.405275 17477 webserver.cc:460] Webserver started at http://127.13.30.190:35331/ using document root <none> and password file <none>
I20260811 01:05:15.405601 17477 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:15.405655 17477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:15.405804 17477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:15.406968 17477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "90d798e3256a478980011b81d027ca83"
format_stamp: "Formatted at 2026-08-11 01:05:15 on dist-test-slave-42z9"
server_key: "c72e70a0066bc4fe75d088aca979ce65"
server_key_iv: "cbd60209152db6a6ab182b0a118eb4ff"
server_key_version: "encryptionkey@0"
I20260811 01:05:15.407320 17477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "90d798e3256a478980011b81d027ca83"
format_stamp: "Formatted at 2026-08-11 01:05:15 on dist-test-slave-42z9"
server_key: "c72e70a0066bc4fe75d088aca979ce65"
server_key_iv: "cbd60209152db6a6ab182b0a118eb4ff"
server_key_version: "encryptionkey@0"
I20260811 01:05:15.408759 17477 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:05:15.409593 17501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:15.409757 17477 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:15.409847 17477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "90d798e3256a478980011b81d027ca83"
format_stamp: "Formatted at 2026-08-11 01:05:15 on dist-test-slave-42z9"
server_key: "c72e70a0066bc4fe75d088aca979ce65"
server_key_iv: "cbd60209152db6a6ab182b0a118eb4ff"
server_key_version: "encryptionkey@0"
I20260811 01:05:15.409909 17477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:15.423902 17477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:15.426357 17477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:15.426508 17477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:15.430644 17477 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:36143
I20260811 01:05:15.430693 17593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:36143 every 8 connection(s)
I20260811 01:05:15.431066 17477 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:05:15.432029 17595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:15.434314 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 17477
I20260811 01:05:15.434469 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:05:15.434686 13434 external_mini_cluster.cc:1428] Setting key ed045a8a2c41eed45ffaa2868353e44f
I20260811 01:05:15.434679 17595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83: Bootstrap starting.
I20260811 01:05:15.435460 17595 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:15.435775 17595 log.cc:824] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:15.436496 17595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83: No bootstrap required, opened a new log
I20260811 01:05:15.438484 17595 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90d798e3256a478980011b81d027ca83" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36143 } }
I20260811 01:05:15.438653 17595 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:05:15.438686 17595 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90d798e3256a478980011b81d027ca83, State: Initialized, Role: FOLLOWER
I20260811 01:05:15.438820 17595 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90d798e3256a478980011b81d027ca83" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36143 } }
I20260811 01:05:15.438897 17595 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:05:15.438958 17595 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:05:15.439013 17595 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:15.439684 17595 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90d798e3256a478980011b81d027ca83" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36143 } }
I20260811 01:05:15.439795 17595 leader_election.cc:302] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90d798e3256a478980011b81d027ca83; no voters:
I20260811 01:05:15.439992 17595 leader_election.cc:288] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:05:15.440045 17606 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:05:15.440344 17606 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [term 1 LEADER]: Becoming Leader. State: Replica: 90d798e3256a478980011b81d027ca83, State: Running, Role: LEADER
I20260811 01:05:15.440380 17595 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:15.440352 17599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:15.435445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35373 (local address 127.13.30.190:36143)
0811 01:05:15.435659 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:15.435667 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:15.435691 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:05:15.436204 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:15.436211 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:15.436265 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:15.436406 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:15.436665 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:15.437637 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:15.438403 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:15.438864 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:15.438974 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:15.439654 (+ 680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:15.439657 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:15.439658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:15.439858 (+ 200us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:15.439905 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:15.439921 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:15.439981 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:15.440056 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 01:05:15.440130 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":90,"threads_started":1}
I20260811 01:05:15.440515 17606 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90d798e3256a478980011b81d027ca83" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36143 } }
I20260811 01:05:15.441115 17608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90d798e3256a478980011b81d027ca83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90d798e3256a478980011b81d027ca83" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36143 } } }
I20260811 01:05:15.441469 17608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:15.441483 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:05:15.441319 17609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90d798e3256a478980011b81d027ca83. Latest consensus state: current_term: 1 leader_uuid: "90d798e3256a478980011b81d027ca83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90d798e3256a478980011b81d027ca83" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 36143 } } }
I20260811 01:05:15.441766 17609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83 [sys.catalog]: This master's current role is: LEADER
W20260811 01:05:15.442248 17627 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:05:15.442309 17627 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:05:15.442466 17625 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:05:15.442662 17625 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:05:15.444316 17625 catalog_manager.cc:1347] Generated new cluster ID: fab2f37ab16648ca8c557be62e190c50
I20260811 01:05:15.444376 17625 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:05:15.446715 17599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:15.443095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42935 (local address 127.13.30.190:36143)
0811 01:05:15.443135 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:15.443138 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:15.443213 (+ 75us) server_negotiation.cc:407] Connection header received
0811 01:05:15.443274 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:15.443275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:15.443286 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:15.443334 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:15.443545 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:15.444262 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:15.445311 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:15.445651 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:15.445729 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:15.446446 (+ 717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:15.446448 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:15.446448 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:15.446453 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:15.446470 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:15.446474 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:15.446535 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:15.446608 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 01:05:15.446634 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 01:05:15.469005 17625 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:05:15.469617 17625 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:05:15.473762 17625 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90d798e3256a478980011b81d027ca83: Generated new TSK 0
I20260811 01:05:15.473968 17625 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:05:15.478700 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 17477
2026-08-11T01:05:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1511 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:05:15 dist-test-slave-42z9 krb5kdc[17650](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:05:15 dist-test-slave-42z9 krb5kdc[17650](info): set up 2 sockets
Aug 11 01:05:15 dist-test-slave-42z9 krb5kdc[17650](info): commencing operation
krb5kdc: starting...
W20260811 01:05:16.671591 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:05:16 dist-test-slave-42z9 krb5kdc[17650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:05:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:05:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:05:16.810734 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:46711
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:39055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:46711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:05:16.897677 17670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:16.897907 17670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:16.897931 17670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:16.899232 17670 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:16.899309 17670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:16.899324 17670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:16.899336 17670 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:16.899348 17670 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:16.901113 17670 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:39055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:46711
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:46711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:16.901400 17670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:16.901717 17670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:16.907493 17679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:16.907769 17670 server_base.cc:1034] running on GCE node
W20260811 01:05:16.907480 17678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:16.907480 17683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:16.908258 17670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:16.908648 17670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:16.909798 17670 hybrid_clock.cc:648] HybridClock initialized: now 1786410316909784 us; error 44 us; skew 500 ppm
Aug 11 01:05:16 dist-test-slave-42z9 krb5kdc[17650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410316, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:16.912899 17670 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:05:16.913627 17670 webserver.cc:460] Webserver started at http://127.13.30.190:42755/ using document root <none> and password file <none>
I20260811 01:05:16.913921 17670 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:16.913980 17670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:16.914134 17670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:16.915498 17670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "f4d7a5ecc21744bea430da1f56de3f1f"
format_stamp: "Formatted at 2026-08-11 01:05:16 on dist-test-slave-42z9"
server_key: "0b46e4c04b89ff9534d1771affacb7a1"
server_key_iv: "bf175559168b652e19c3015907b8165c"
server_key_version: "encryptionkey@0"
I20260811 01:05:16.915904 17670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "f4d7a5ecc21744bea430da1f56de3f1f"
format_stamp: "Formatted at 2026-08-11 01:05:16 on dist-test-slave-42z9"
server_key: "0b46e4c04b89ff9534d1771affacb7a1"
server_key_iv: "bf175559168b652e19c3015907b8165c"
server_key_version: "encryptionkey@0"
I20260811 01:05:16.917471 17670 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:05:16.918622 17693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:16.918905 17670 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:16.919031 17670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "f4d7a5ecc21744bea430da1f56de3f1f"
format_stamp: "Formatted at 2026-08-11 01:05:16 on dist-test-slave-42z9"
server_key: "0b46e4c04b89ff9534d1771affacb7a1"
server_key_iv: "bf175559168b652e19c3015907b8165c"
server_key_version: "encryptionkey@0"
I20260811 01:05:16.919145 17670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:16.922880 17670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:16.925006 17670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:16.925166 17670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:16.929255 17670 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:46711
I20260811 01:05:16.929299 17790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:46711 every 8 connection(s)
I20260811 01:05:16.929688 17670 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:05:16.930691 17793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:16.932969 17793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f: Bootstrap starting.
I20260811 01:05:16.933599 17793 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:16.933851 17793 log.cc:824] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:16.934921 17793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f: No bootstrap required, opened a new log
I20260811 01:05:16.936781 17793 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d7a5ecc21744bea430da1f56de3f1f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46711 } }
I20260811 01:05:16.936956 17793 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:05:16.936980 17793 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4d7a5ecc21744bea430da1f56de3f1f, State: Initialized, Role: FOLLOWER
I20260811 01:05:16.937091 17793 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d7a5ecc21744bea430da1f56de3f1f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46711 } }
I20260811 01:05:16.937147 17793 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:05:16.937168 17793 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:05:16.937224 17793 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:16.937479 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 17670
I20260811 01:05:16.937600 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:05:16.937781 13434 external_mini_cluster.cc:1428] Setting key 216cceea61a3d5bf1efb5d30d5869d8b
I20260811 01:05:16.938388 17793 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d7a5ecc21744bea430da1f56de3f1f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46711 } }
I20260811 01:05:16.938517 17793 leader_election.cc:302] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4d7a5ecc21744bea430da1f56de3f1f; no voters:
I20260811 01:05:16.938686 17793 leader_election.cc:288] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:05:16.938717 17805 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:05:16.938892 17805 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [term 1 LEADER]: Becoming Leader. State: Replica: f4d7a5ecc21744bea430da1f56de3f1f, State: Running, Role: LEADER
I20260811 01:05:16.938956 17793 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:16.938987 17805 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d7a5ecc21744bea430da1f56de3f1f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46711 } }
I20260811 01:05:16.939353 17805 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4d7a5ecc21744bea430da1f56de3f1f. Latest consensus state: current_term: 1 leader_uuid: "f4d7a5ecc21744bea430da1f56de3f1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d7a5ecc21744bea430da1f56de3f1f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46711 } } }
I20260811 01:05:16.939435 17805 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:16.939599 17810 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4d7a5ecc21744bea430da1f56de3f1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4d7a5ecc21744bea430da1f56de3f1f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 46711 } } }
I20260811 01:05:16.939661 17810 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:16.939800 17818 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:05:16.940399 17801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:16.938283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41931 (local address 127.13.30.190:46711)
0811 01:05:16.938471 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:16.938482 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:16.938519 (+ 37us) server_negotiation.cc:407] Connection header received
0811 01:05:16.938645 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:16.938652 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:16.938682 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:16.938827 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:16.939810 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:16.939814 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:16.939814 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:16.939819 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:16.939868 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:16.939883 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:16.939946 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:16.940116 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 01:05:16.940162 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
I20260811 01:05:16.940479 17818 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:05:16.941425 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:05:16.942289 17818 catalog_manager.cc:1347] Generated new cluster ID: d9af86d199f9440abc8fb7527f309f75
I20260811 01:05:16.942358 17818 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:05:16.944056 17801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:16.943033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42961 (local address 127.13.30.190:46711)
0811 01:05:16.943073 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:16.943075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:16.943189 (+ 114us) server_negotiation.cc:407] Connection header received
0811 01:05:16.943249 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:16.943250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:16.943255 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:16.943300 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:16.943842 (+ 542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:16.943843 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:16.943844 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:05:16.943848 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:16.943864 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:05:16.943868 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:16.943917 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:16.943975 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 01:05:16.943989 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 01:05:16.957576 17818 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:05:16.957775 17818 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:05:16.962940 17818 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4d7a5ecc21744bea430da1f56de3f1f: Generated new TSK 0
I20260811 01:05:16.963153 17818 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:05:16.969475 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 17670
2026-08-11T01:05:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1495 ms)
[----------] 18 tests from AuthTokenIssuingTest (27523 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:05:17 dist-test-slave-42z9 krb5kdc[17859](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:05:17 dist-test-slave-42z9 krb5kdc[17859](info): set up 2 sockets
Aug 11 01:05:17 dist-test-slave-42z9 krb5kdc[17859](info): commencing operation
krb5kdc: starting...
W20260811 01:05:18.158532 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:05:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:05:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:05:18.297667 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:38899
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:38899,127.13.30.189:37403,127.13.30.188:45483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:05:18.386016 17881 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:05:18.386299 17881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:18.386318 17881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:18.386340 17881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:18.387624 17881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:18.387678 17881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:18.387691 17881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:18.387703 17881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:18.387713 17881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:18.389357 17881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:38899,127.13.30.189:37403,127.13.30.188:45483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:38899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:18.389640 17881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:18.389856 17881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:18.395133 17896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:18.395176 17881 server_base.cc:1034] running on GCE node
W20260811 01:05:18.395181 17892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:18.395167 17891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:18.395591 17881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:18.395911 17881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:18.397126 17881 hybrid_clock.cc:648] HybridClock initialized: now 1786410318397078 us; error 66 us; skew 500 ppm
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:18.400305 17881 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:05:18.400851 17881 webserver.cc:460] Webserver started at http://127.13.30.190:38085/ using document root <none> and password file <none>
I20260811 01:05:18.401073 17881 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:18.401121 17881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:18.401225 17881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:18.402406 17881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "049652db32934563b819b5edc9c575c9"
format_stamp: "Formatted at 2026-08-11 01:05:18 on dist-test-slave-42z9"
server_key: "a90f00a339b955421364f99a218ccd94"
server_key_iv: "dccc92ae96575f6521669247dbb05eaa"
server_key_version: "encryptionkey@0"
I20260811 01:05:18.402735 17881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "049652db32934563b819b5edc9c575c9"
format_stamp: "Formatted at 2026-08-11 01:05:18 on dist-test-slave-42z9"
server_key: "a90f00a339b955421364f99a218ccd94"
server_key_iv: "dccc92ae96575f6521669247dbb05eaa"
server_key_version: "encryptionkey@0"
I20260811 01:05:18.404170 17881 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 01:05:18.405167 17908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:18.405419 17881 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:18.405571 17881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "049652db32934563b819b5edc9c575c9"
format_stamp: "Formatted at 2026-08-11 01:05:18 on dist-test-slave-42z9"
server_key: "a90f00a339b955421364f99a218ccd94"
server_key_iv: "dccc92ae96575f6521669247dbb05eaa"
server_key_version: "encryptionkey@0"
I20260811 01:05:18.405663 17881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:18.420264 17881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:18.423018 17881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:18.423168 17881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:18.427675 17881 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:38899
I20260811 01:05:18.427781 17992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:38899 every 8 connection(s)
I20260811 01:05:18.428081 17881 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:05:18.429152 17993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:18.430923 17993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:05:18.434299 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 17881
I20260811 01:05:18.434434 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:05:18.434705 13434 external_mini_cluster.cc:1428] Setting key 83252a8913937f68394ed3b00ba6e7be
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:05:18.440883 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.431685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:38899 (local address 127.0.0.1:52854)
0811 01:05:18.431905 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.431951 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:18.432462 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:18.432717 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:18.432720 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:18.433021 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:18.433186 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.433190 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.434259 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.434260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.435043 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.435046 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.435528 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.435529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.435597 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.436112 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:18.436120 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:18.437700 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:18.439433 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.439440 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.439443 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.439650 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.439864 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.439865 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.439865 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.439947 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.440292 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:18.440298 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:18.440362 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 01:05:18.440446 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 01:05:18.440692 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":90,"thread_start_us":123,"threads_started":1}
I20260811 01:05:18.440883 17995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.431717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52854 (local address 127.13.30.190:38899)
0811 01:05:18.431915 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.431926 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.432042 (+ 116us) server_negotiation.cc:407] Connection header received
0811 01:05:18.432610 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.432612 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.432630 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.432708 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.433279 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.434157 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.435122 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.435437 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.435538 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.437801 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.437808 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.437809 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.437816 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.439343 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.439726 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.439729 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.439730 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.439807 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.440001 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.440002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.440002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.440231 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.440305 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.440498 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.440614 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":106,"threads_started":1}
I20260811 01:05:18.442198 17993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:05:18.442767 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.442565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37403 (local address 127.0.0.1:54388)
0811 01:05:18.442654 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.442731 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 01:05:18.442957 17912 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37403: connect: Connection refused (error 111)
I20260811 01:05:18.443506 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.443413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37403 (local address 127.0.0.1:54404)
0811 01:05:18.443454 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.443482 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
WARNING: no policy specified for kudu/127.13.30.189@KRBTEST.COM; defaulting to no policy
W20260811 01:05:18.443722 17993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.189:37403: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37403: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.189.keytab.
Entry for principal kudu/127.13.30.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.189.keytab.
I20260811 01:05:18.464460 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.189:37403
--webserver_interface=127.13.30.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.189.keytab
--principal=kudu/127.13.30.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:38899,127.13.30.189:37403,127.13.30.188:45483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:05:18.492983 17993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } attempt: 1
I20260811 01:05:18.493631 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.493430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37403 (local address 127.0.0.1:54418)
0811 01:05:18.493550 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.493596 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260811 01:05:18.493952 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.493876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37403 (local address 127.0.0.1:54420)
0811 01:05:18.493912 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.493935 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 01:05:18.494050 17993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.189:37403: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37403: connect: Connection refused (error 111)
W20260811 01:05:18.548893 18006 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:05:18.549144 18006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:18.549161 18006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:18.549183 18006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:18.550446 18006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:18.550498 18006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:18.550511 18006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:18.550523 18006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:18.550534 18006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:18.552217 18006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:38899,127.13.30.189:37403,127.13.30.188:45483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.189.keytab
--principal=kudu/127.13.30.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.189:37403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.30.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:18.552490 18006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:18.552721 18006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:18.557687 18015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:18.557690 18017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:18.557690 18021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:18.557991 18006 server_base.cc:1034] running on GCE node
I20260811 01:05:18.558233 18006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:18.558542 18006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:18.559690 18006 hybrid_clock.cc:648] HybridClock initialized: now 1786410318559672 us; error 28 us; skew 500 ppm
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:18.562191 17993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } attempt: 2
I20260811 01:05:18.562721 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.562464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37403 (local address 127.0.0.1:54430)
0811 01:05:18.562602 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.562665 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 01:05:18.562793 18006 init.cc:377] Logged in from keytab as kudu/127.13.30.189@KRBTEST.COM (short username kudu)
I20260811 01:05:18.563162 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.563039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37403 (local address 127.0.0.1:54434)
0811 01:05:18.563092 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.563123 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 01:05:18.563277 17993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.189:37403: Network error: Client connection negotiation failed: client connection to 127.13.30.189:37403: connect: Connection refused (error 111)
I20260811 01:05:18.563512 18006 webserver.cc:460] Webserver started at http://127.13.30.189:38287/ using document root <none> and password file <none>
I20260811 01:05:18.563795 18006 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:18.563848 18006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:18.564013 18006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:18.565320 18006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/data/instance:
uuid: "4f20b25a4f244a22bfa3d60f31c49024"
format_stamp: "Formatted at 2026-08-11 01:05:18 on dist-test-slave-42z9"
server_key: "2992f6ca6423f4ef02de5ed7c447e374"
server_key_iv: "9db98ed5e98cc0e0c6d96aafb4b53ed1"
server_key_version: "encryptionkey@0"
I20260811 01:05:18.565764 18006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/wal/instance:
uuid: "4f20b25a4f244a22bfa3d60f31c49024"
format_stamp: "Formatted at 2026-08-11 01:05:18 on dist-test-slave-42z9"
server_key: "2992f6ca6423f4ef02de5ed7c447e374"
server_key_iv: "9db98ed5e98cc0e0c6d96aafb4b53ed1"
server_key_version: "encryptionkey@0"
I20260811 01:05:18.567216 18006 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:18.568094 18043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:18.568274 18006 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:18.568387 18006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/wal
uuid: "4f20b25a4f244a22bfa3d60f31c49024"
format_stamp: "Formatted at 2026-08-11 01:05:18 on dist-test-slave-42z9"
server_key: "2992f6ca6423f4ef02de5ed7c447e374"
server_key_iv: "9db98ed5e98cc0e0c6d96aafb4b53ed1"
server_key_version: "encryptionkey@0"
I20260811 01:05:18.568464 18006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:18.578744 18006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:18.581991 18006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:18.582165 18006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:18.589676 18006 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.189:37403
I20260811 01:05:18.589730 18136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.189:37403 every 8 connection(s)
I20260811 01:05:18.590211 18006 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/data/info.pb
I20260811 01:05:18.590651 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 18006
I20260811 01:05:18.590758 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-1/wal/instance
I20260811 01:05:18.590967 13434 external_mini_cluster.cc:1428] Setting key 03b8dce04e09dec528f474fdee6dc95e
I20260811 01:05:18.591451 18138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:18.593047 18138 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.13.30.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.188@KRBTEST.COM" created.
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.189@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:05:18.606467 17995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.594159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52864 (local address 127.13.30.190:38899)
0811 01:05:18.594209 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.594211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.594222 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:05:18.594741 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.594742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.594756 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.594809 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.595521 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.596170 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.597258 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.597593 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.597672 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.603384 (+ 5712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.603386 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.603387 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.603395 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.604723 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.605336 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.605337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.605338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.605407 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.605743 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.605744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.605744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.605869 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.605930 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.606307 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.606393 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 01:05:18.606709 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.593861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:38899 (local address 127.0.0.1:52864)
0811 01:05:18.594052 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.594099 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:18.594632 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:18.594885 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:18.594889 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:18.595169 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:18.595432 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.595437 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.596288 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.596290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.597161 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.597165 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.597790 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.597793 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.597995 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.598680 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:18.598691 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:18.603251 (+ 4560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:18.604828 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.604845 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.604849 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.605230 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.605543 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.605544 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.605545 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.605675 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.605963 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:18.605971 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:18.606146 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 01:05:18.606268 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 01:05:18.606469 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":94,"threads_started":1}
I20260811 01:05:18.607268 18138 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.189@KRBTEST.COM for kudu/127.13.30.189@KRBTEST.COM
I20260811 01:05:18.615962 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.607536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37403 (local address 127.0.0.1:54446)
0811 01:05:18.607580 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.607590 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:18.607634 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:18.607975 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:18.607976 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:18.608132 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:18.608192 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.608193 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.609483 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.609484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.610013 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.610014 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.610742 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.610743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.610808 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.611221 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:18.611226 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:18.612692 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:18.614617 (+ 1925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.614618 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.614619 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.614800 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.615052 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.615053 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.615053 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.615115 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.615538 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:18.615541 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:18.615665 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 01:05:18.615763 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 01:05:18.615874 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 01:05:18.616065 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.607602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54446 (local address 127.13.30.189:37403)
0811 01:05:18.607799 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.607804 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.607829 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:05:18.607851 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.607854 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.607868 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.607959 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.608258 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.609362 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.610183 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.610665 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.610742 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.612780 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.612790 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.612791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.612798 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.614545 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.614912 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.614916 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.614917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.614986 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.615168 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.615168 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.615168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.615320 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.615384 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.615829 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.615951 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":162,"thread_start_us":113,"threads_started":1}
I20260811 01:05:18.616659 18138 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:05:18.617161 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.616962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45483 (local address 127.0.0.1:59330)
0811 01:05:18.617075 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.617136 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260811 01:05:18.617297 18047 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
I20260811 01:05:18.618057 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.617928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45483 (local address 127.0.0.1:59336)
0811 01:05:18.618001 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.618033 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 01:05:18.618183 18138 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:45483: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.188.keytab.
Entry for principal kudu/127.13.30.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.188.keytab.
I20260811 01:05:18.620571 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.188:45483
--webserver_interface=127.13.30.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.188.keytab
--principal=kudu/127.13.30.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:38899,127.13.30.189:37403,127.13.30.188:45483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:05:18.654477 17993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } attempt: 3
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for kudu/127.13.30.189@KRBTEST.COM
I20260811 01:05:18.661795 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.654997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54462 (local address 127.13.30.189:37403)
0811 01:05:18.655075 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.655077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.655086 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:05:18.655115 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.655116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.655127 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.655172 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.655579 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.656092 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.656792 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.657025 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.657085 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.659329 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.659331 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.659331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.659340 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.660684 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.661020 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.661021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.661022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.661076 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.661242 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.661242 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.661243 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.661357 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.661414 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.661596 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.661683 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 01:05:18.661795 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.654907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37403 (local address 127.0.0.1:54462)
0811 01:05:18.654964 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.654988 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:18.655035 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:18.655185 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:18.655186 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:18.655382 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:18.655482 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.655485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.656173 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.656174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.656704 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.656706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.657088 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.657089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.657163 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.657666 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:18.657671 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:18.659222 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:18.660773 (+ 1551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.660775 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.660775 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.660946 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.661132 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.661133 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.661133 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.661192 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.661415 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:18.661416 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:18.661499 (+ 83us) client_negotiation.cc:769] Sending connection context
0811 01:05:18.661565 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 01:05:18.661686 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 01:05:18.662220 17993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:05:18.662571 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.662463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45483 (local address 127.0.0.1:59352)
0811 01:05:18.662515 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.662545 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 01:05:18.662911 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.662833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45483 (local address 127.0.0.1:59360)
0811 01:05:18.662873 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.662897 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 01:05:18.662997 17993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:45483: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
I20260811 01:05:18.667452 18138 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } attempt: 1
I20260811 01:05:18.667948 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.667822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45483 (local address 127.0.0.1:59372)
0811 01:05:18.667882 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.667922 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 01:05:18.668252 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.668182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45483 (local address 127.0.0.1:59374)
0811 01:05:18.668216 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.668238 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 01:05:18.668335 18138 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:45483: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
I20260811 01:05:18.694175 17993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } attempt: 1
I20260811 01:05:18.694738 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.694603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45483 (local address 127.0.0.1:59388)
0811 01:05:18.694669 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.694705 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 01:05:18.695129 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.694992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45483 (local address 127.0.0.1:59398)
0811 01:05:18.695053 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.695098 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 01:05:18.695228 17993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:45483: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
W20260811 01:05:18.709759 18146 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:05:18.710016 18146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:18.710035 18146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:18.710058 18146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:18.711292 18146 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:18.711338 18146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:18.711351 18146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:18.711362 18146 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:18.711380 18146 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:18.713044 18146 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:38899,127.13.30.189:37403,127.13.30.188:45483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.188.keytab
--principal=kudu/127.13.30.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.188:45483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.30.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:18.713305 18146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:18.713557 18146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:18.720041 18154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:18.720119 18156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:18.720115 18153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:18.720191 18146 server_base.cc:1034] running on GCE node
I20260811 01:05:18.720692 18146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:18.721009 18146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:18.722147 18146 hybrid_clock.cc:648] HybridClock initialized: now 1786410318722139 us; error 35 us; skew 500 ppm
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:18.725024 18146 init.cc:377] Logged in from keytab as kudu/127.13.30.188@KRBTEST.COM (short username kudu)
I20260811 01:05:18.725618 18146 webserver.cc:460] Webserver started at http://127.13.30.188:39315/ using document root <none> and password file <none>
I20260811 01:05:18.725878 18146 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:18.725936 18146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:18.726086 18146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:18.727249 18146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/data/instance:
uuid: "5580efbaf5db483eac0b8f766452757b"
format_stamp: "Formatted at 2026-08-11 01:05:18 on dist-test-slave-42z9"
server_key: "4316d42e58ccfad3f17c3e0f7bf9a676"
server_key_iv: "51d05e0431a0cb7f7cb0f13daee28eb5"
server_key_version: "encryptionkey@0"
I20260811 01:05:18.727627 18146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/wal/instance:
uuid: "5580efbaf5db483eac0b8f766452757b"
format_stamp: "Formatted at 2026-08-11 01:05:18 on dist-test-slave-42z9"
server_key: "4316d42e58ccfad3f17c3e0f7bf9a676"
server_key_iv: "51d05e0431a0cb7f7cb0f13daee28eb5"
server_key_version: "encryptionkey@0"
I20260811 01:05:18.729060 18146 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:05:18.729908 18165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:18.730065 18146 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:18.730158 18146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/wal
uuid: "5580efbaf5db483eac0b8f766452757b"
format_stamp: "Formatted at 2026-08-11 01:05:18 on dist-test-slave-42z9"
server_key: "4316d42e58ccfad3f17c3e0f7bf9a676"
server_key_iv: "51d05e0431a0cb7f7cb0f13daee28eb5"
server_key_version: "encryptionkey@0"
I20260811 01:05:18.730232 18146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:18.736533 18138 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } attempt: 2
I20260811 01:05:18.737187 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.737031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45483 (local address 127.0.0.1:59408)
0811 01:05:18.737101 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.737149 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 01:05:18.737632 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.737418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45483 (local address 127.0.0.1:59418)
0811 01:05:18.737495 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.737522 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 01:05:18.737985 18138 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:45483: Network error: Client connection negotiation failed: client connection to 127.13.30.188:45483: connect: Connection refused (error 111)
I20260811 01:05:18.740377 18146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:18.743330 18146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:18.743510 18146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:18.747886 18146 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.188:45483
I20260811 01:05:18.747920 18246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.188:45483 every 8 connection(s)
I20260811 01:05:18.748314 18146 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/data/info.pb
I20260811 01:05:18.749424 18248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:18.751179 18248 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:05:18.757180 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 18146
I20260811 01:05:18.757320 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786410030080353-13434-0/minicluster-data/master-2/wal/instance
I20260811 01:05:18.757781 13434 external_mini_cluster.cc:1428] Setting key 693cfe0472e6d0f9db56142551d38c5c
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.188@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:05:18.762324 17995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.751983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52878 (local address 127.13.30.190:38899)
0811 01:05:18.752053 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.752056 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.752262 (+ 206us) server_negotiation.cc:407] Connection header received
0811 01:05:18.752765 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.752766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.752777 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.752838 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.753552 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.754039 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.755218 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.755418 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.755479 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.758758 (+ 3279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.758760 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.758760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.758768 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.760419 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.761086 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.761091 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.761091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.761200 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.761614 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.761615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.761615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.761743 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.761814 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.762119 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.762227 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 01:05:18.762490 18252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.751916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:38899 (local address 127.0.0.1:52878)
0811 01:05:18.752131 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.752176 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:18.752682 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:18.752910 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:18.752915 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:18.753209 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:18.753429 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.753434 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.754123 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.754125 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.755081 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.755085 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.755627 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.755630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.755827 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.756554 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:18.756566 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:18.758654 (+ 2088us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:18.760575 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.760590 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.760594 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.760940 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.761329 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.761330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.761331 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.761540 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.761807 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:18.761815 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:18.761979 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 01:05:18.762071 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 01:05:18.762255 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":100,"threads_started":1}
I20260811 01:05:18.763087 18248 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.188@KRBTEST.COM
I20260811 01:05:18.767450 18263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.758306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59426 (local address 127.13.30.188:45483)
0811 01:05:18.758501 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.758506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.758591 (+ 85us) server_negotiation.cc:407] Connection header received
0811 01:05:18.758656 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.758659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.758673 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.758746 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.759468 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.760306 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.761082 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.761424 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.761511 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.764194 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.764203 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.764203 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.764210 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.766220 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.766642 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.766647 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.766647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.766704 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.766873 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.766874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.766874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.767052 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.767167 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.767297 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.767366 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":126,"threads_started":1}
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.188@KRBTEST.COM for kudu/127.13.30.189@KRBTEST.COM
I20260811 01:05:18.770423 18252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.763363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:37403 (local address 127.0.0.1:54468)
0811 01:05:18.763415 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.763426 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:18.763474 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:18.763607 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:18.763608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:18.763729 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:18.763794 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.763796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.764826 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.764827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.765631 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.765635 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.766014 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.766015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.766106 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.766467 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:18.766472 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:18.767826 (+ 1354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:18.769481 (+ 1655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.769482 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.769483 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.769654 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.769849 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.769850 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.769850 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.769911 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.770167 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:18.770167 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:18.770202 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 01:05:18.770246 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 01:05:18.770327 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 01:05:18.770373 17993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } attempt: 2
I20260811 01:05:18.770473 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.763434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54468 (local address 127.13.30.189:37403)
0811 01:05:18.763493 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.763495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.763505 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:05:18.763532 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.763533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.763544 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.763602 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.763884 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.764728 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.765713 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.765933 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.765992 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.767909 (+ 1917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.767910 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.767911 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.767920 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.769374 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.769719 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.769720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.769721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.769782 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.769964 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.769965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.769965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.770110 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.770178 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.770286 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.770372 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 01:05:18.771540 18248 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for kudu/127.13.30.188@KRBTEST.COM
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.188@KRBTEST.COM for kudu/127.13.30.188@KRBTEST.COM
I20260811 01:05:18.776497 17995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.768375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52886 (local address 127.13.30.190:38899)
0811 01:05:18.768428 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.768430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.768476 (+ 46us) server_negotiation.cc:407] Connection header received
0811 01:05:18.768569 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.768570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.768579 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.768621 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.769174 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.769707 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.770708 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.770964 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.771053 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.773620 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.773621 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.773622 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.773628 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.775067 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.775414 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.775415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.775416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.775476 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.775650 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.775651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.775651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.775768 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.776181 (+ 413us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.776241 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.776360 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 01:05:18.780061 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.770648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45483 (local address 127.0.0.1:59436)
0811 01:05:18.770732 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.770742 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:18.770776 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:18.771053 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:18.771054 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:18.771196 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:18.771232 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.771234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.772130 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.772131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.772908 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.772912 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.773387 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.773389 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.773477 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.774045 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:18.774050 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:18.775892 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:18.778954 (+ 3062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.778955 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.778956 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.779153 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.779342 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.779343 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.779343 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.779405 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.779704 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:18.779705 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:18.779761 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 01:05:18.779829 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 01:05:18.779944 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 01:05:18.780052 18263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.770891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59436 (local address 127.13.30.188:45483)
0811 01:05:18.770944 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.770946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.770952 (+ 6us) server_negotiation.cc:407] Connection header received
0811 01:05:18.770971 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.770971 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.770983 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.771033 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.771306 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.772018 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.773007 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.773314 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.773384 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.776722 (+ 3338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.776724 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.776724 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.776733 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.778845 (+ 2112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.779221 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.779221 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.779222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.779269 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.779460 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.779460 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.779461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.779638 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.779708 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.779860 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.779943 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 01:05:18.780297 18252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.771789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45483 (local address 127.0.0.1:59452)
0811 01:05:18.771980 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.771989 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:18.772028 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:18.772176 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:18.772177 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:18.772298 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:18.772325 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.772326 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.772958 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.772959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.773560 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.773563 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.774015 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.774016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.774075 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.774414 (+ 339us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:18.774418 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:18.776236 (+ 1818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:18.779367 (+ 3131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.779368 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.779368 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.779563 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.779746 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.779747 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.779747 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.779796 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.780014 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:18.780015 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:18.780048 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 01:05:18.780099 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 01:05:18.780197 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175}
I20260811 01:05:18.780691 18264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.771818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59452 (local address 127.13.30.188:45483)
0811 01:05:18.772007 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.772008 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.772016 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:05:18.772080 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.772081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.772089 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.772142 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.772388 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.772890 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.773646 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.773934 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.773996 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.776322 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.776323 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.776323 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.776330 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.779261 (+ 2931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.779627 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.779628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.779628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.779682 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.779848 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.779848 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.779848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.779948 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.779997 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.780479 (+ 482us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.780554 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":125,"threads_started":1}
I20260811 01:05:18.781977 17993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9: Bootstrap starting.
I20260811 01:05:18.782255 18248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b: Bootstrap starting.
I20260811 01:05:18.782709 17993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:18.783054 17993 log.cc:824] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:18.783087 18248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:18.783367 18248 log.cc:824] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b: Log is configured to *not* fsync() on all Append() calls
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.189@KRBTEST.COM
I20260811 01:05:18.784045 17993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9: No bootstrap required, opened a new log
I20260811 01:05:18.786012 17993 raft_consensus.cc:348] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } }
I20260811 01:05:18.786145 18248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b: No bootstrap required, opened a new log
I20260811 01:05:18.786175 17993 raft_consensus.cc:729] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 049652db32934563b819b5edc9c575c9, State: Initialized, Role: FOLLOWER
I20260811 01:05:18.786260 17993 consensus_queue.cc:260] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } }
I20260811 01:05:18.786557 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.778234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54472 (local address 127.13.30.189:37403)
0811 01:05:18.778286 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.778288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.778298 (+ 10us) server_negotiation.cc:407] Connection header received
0811 01:05:18.778330 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.778331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.778343 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.778400 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.778988 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.779727 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.780671 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.780995 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.781040 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.784092 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.784094 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.784094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.784103 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.785479 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.785836 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.785837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.785838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.785898 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.786063 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.786064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.786065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.786186 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.786343 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.786383 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.786466 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 01:05:18.786634 17993 sys_catalog.cc:564] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:18.786986 18270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } } }
I20260811 01:05:18.787076 18270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:05:18.787992 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:05:18.788295 18248 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } }
I20260811 01:05:18.788507 18248 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5580efbaf5db483eac0b8f766452757b, State: Initialized, Role: FOLLOWER
I20260811 01:05:18.788707 18248 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } }
I20260811 01:05:18.789096 18248 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:18.789058 17954 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "049652db32934563b819b5edc9c575c9"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52886
I20260811 01:05:18.789166 17954 raft_consensus.cc:482] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 01:05:18.789227 17954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:18.789605 18295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } } }
I20260811 01:05:18.789731 18295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:05:18.790274 17954 raft_consensus.cc:504] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } }
I20260811 01:05:18.790545 17954 leader_election.cc:288] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [CANDIDATE]: Term 1 election: Requested vote from peers 4f20b25a4f244a22bfa3d60f31c49024 (127.13.30.189:37403), 5580efbaf5db483eac0b8f766452757b (127.13.30.188:45483)
W20260811 01:05:18.789165 18291 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:05:18.791067 18291 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:05:18.789963 17881 master_runner.cc:186] Error getting master registration for 127.13.30.189:37403: OK, instance_id { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" instance_seqno: 1786410318586006 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:05:18.793246 17881 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:05:18.791955 18205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "049652db32934563b819b5edc9c575c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5580efbaf5db483eac0b8f766452757b"
I20260811 01:05:18.793799 18205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:18.794808 18205 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 049652db32934563b819b5edc9c575c9 in term 1.
I20260811 01:05:18.795140 17912 leader_election.cc:302] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 049652db32934563b819b5edc9c575c9, 5580efbaf5db483eac0b8f766452757b; no voters:
I20260811 01:05:18.795351 18270 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:05:18.795549 18270 raft_consensus.cc:686] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [term 1 LEADER]: Becoming Leader. State: Replica: 049652db32934563b819b5edc9c575c9, State: Running, Role: LEADER
I20260811 01:05:18.795636 18270 consensus_queue.cc:237] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } }
I20260811 01:05:18.796085 18270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 049652db32934563b819b5edc9c575c9. Latest consensus state: current_term: 1 leader_uuid: "049652db32934563b819b5edc9c575c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } } }
I20260811 01:05:18.796172 18270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [sys.catalog]: This master's current role is: LEADER
W20260811 01:05:18.792897 18314 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:05:18.796540 18314 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:05:18.797551 18327 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:05:18.795457 18146 master_runner.cc:186] Error getting master registration for 127.13.30.189:37403: OK, instance_id { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" instance_seqno: 1786410318586006 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:05:18.797806 18327 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:05:18.797876 18146 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:05:18.799448 18205 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b [term 1 FOLLOWER]: Refusing update from remote peer 049652db32934563b819b5edc9c575c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:05:18.800057 18324 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:05:18.801746 18295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 049652db32934563b819b5edc9c575c9. Latest consensus state: current_term: 1 leader_uuid: "049652db32934563b819b5edc9c575c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } } }
I20260811 01:05:18.801870 18295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:05:18.803399 18332 mvcc.cc:205] Tried to move back new op lower bound from 7317136665799745536 to 7317136665787699200. Current Snapshot: MvccSnapshot[applied={T|T < 7317136665799745536}]
I20260811 01:05:18.803711 18270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "049652db32934563b819b5edc9c575c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } } }
I20260811 01:05:18.803794 18270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:18.804405 18335 mvcc.cc:205] Tried to move back new op lower bound from 7317136665799745536 to 7317136665787699200. Current Snapshot: MvccSnapshot[applied={T|T < 7317136665799745536}]
I20260811 01:05:18.804486 18295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "049652db32934563b819b5edc9c575c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } } }
I20260811 01:05:18.804551 18295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:05:18.806682 18327 catalog_manager.cc:1347] Generated new cluster ID: c60244e88570477bade30c1c99808f7f
I20260811 01:05:18.806733 18327 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:05:18.811424 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.793309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54476 (local address 127.13.30.189:37403)
0811 01:05:18.793588 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.793680 (+ 92us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.801685 (+ 8005us) server_negotiation.cc:407] Connection header received
0811 01:05:18.801758 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.801759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.801786 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.801853 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.803313 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.803988 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.805377 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.805673 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.805739 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.808181 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.808183 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.808183 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.808204 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.809759 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.810367 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.810368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.810368 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.810437 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.810705 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.810706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.810706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.810846 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.810930 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.811224 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.811324 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215}
I20260811 01:05:18.820417 18264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.797172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59468 (local address 127.13.30.188:45483)
0811 01:05:18.797226 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.797228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.801856 (+ 4628us) server_negotiation.cc:407] Connection header received
0811 01:05:18.801952 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.801953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.801966 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.801995 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.802781 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.803561 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.806491 (+ 2930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.806845 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.806888 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.816795 (+ 9907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.816797 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.816797 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.816808 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.818801 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.819486 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.819487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.819487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.819551 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.819741 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.819742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.819742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.819899 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.819984 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.820212 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.820310 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 01:05:18.821813 17995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.797463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52892 (local address 127.13.30.190:38899)
0811 01:05:18.797501 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.797503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.812347 (+ 14844us) server_negotiation.cc:407] Connection header received
0811 01:05:18.812377 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.812378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.812390 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.812437 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.813269 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.814063 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.815636 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.815925 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.815962 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.818141 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.818143 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.818144 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.818152 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.819664 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.820275 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.820276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.820276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.820336 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.820966 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.820968 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.820968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.821120 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.821217 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.821631 (+ 414us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.821718 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 01:05:18.829087 18138 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } attempt: 3
Aug 11 01:05:18 dist-test-slave-42z9 krb5kdc[17859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410318, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.189@KRBTEST.COM for kudu/127.13.30.188@KRBTEST.COM
I20260811 01:05:18.837847 18264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.829584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59478 (local address 127.13.30.188:45483)
0811 01:05:18.829644 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.829646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.829657 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:05:18.829740 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.829741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.829752 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.829802 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.830152 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.830919 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.831888 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.832203 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.832272 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.834809 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:18.834811 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:18.834811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:18.834821 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:18.836538 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.836946 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.836948 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.836948 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.837032 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:18.837222 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:18.837224 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:18.837224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:18.837384 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:18.837465 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:18.837664 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 01:05:18.837757 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 01:05:18.837847 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:18.829536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:45483 (local address 127.0.0.1:59478)
0811 01:05:18.829604 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:18.829617 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:18.829666 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:18.829827 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:18.829828 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:18.830029 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:18.830082 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.830084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.831007 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.831008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.831821 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:18.831823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:18.832281 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:18.832282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:18.832352 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:18.832966 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:18.832971 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:18.834726 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:18.836647 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.836648 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.836648 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.836872 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.837086 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:18.837087 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:18.837087 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:18.837151 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:18.837494 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:18.837495 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:18.837546 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 01:05:18.837616 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 01:05:18.837738 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 01:05:18.839514 18138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024: Bootstrap starting.
I20260811 01:05:18.840315 18138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:18.840623 18138 log.cc:824] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:18.841624 18138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024: No bootstrap required, opened a new log
I20260811 01:05:18.843698 18138 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } }
I20260811 01:05:18.843878 18138 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f20b25a4f244a22bfa3d60f31c49024, State: Initialized, Role: FOLLOWER
I20260811 01:05:18.843968 18138 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } }
I20260811 01:05:18.844352 18138 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:18.844444 18089 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:18.845546 18089 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024 [term 1 FOLLOWER]: Refusing update from remote peer 049652db32934563b819b5edc9c575c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:05:18.845920 18341 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:05:18.846019 18090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "049652db32934563b819b5edc9c575c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4f20b25a4f244a22bfa3d60f31c49024"
I20260811 01:05:18.846901 18090 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 049652db32934563b819b5edc9c575c9 in term 1.
I20260811 01:05:18.848855 18365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "049652db32934563b819b5edc9c575c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } } }
I20260811 01:05:18.849010 18365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:05:18.849088 18365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 049652db32934563b819b5edc9c575c9. Latest consensus state: current_term: 1 leader_uuid: "049652db32934563b819b5edc9c575c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } } }
I20260811 01:05:18.849170 18365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:05:18.849237 18365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "049652db32934563b819b5edc9c575c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } } }
I20260811 01:05:18.849341 18365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:05:18.850524 18363 mvcc.cc:205] Tried to move back new op lower bound from 7317136665799745536 to 7317136665787699200. Current Snapshot: MvccSnapshot[applied={T|T < 7317136665799745536}]
I20260811 01:05:18.853606 18324 sys_catalog.cc:455] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "049652db32934563b819b5edc9c575c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "049652db32934563b819b5edc9c575c9" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 38899 } } peers { permanent_uuid: "4f20b25a4f244a22bfa3d60f31c49024" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 37403 } } peers { permanent_uuid: "5580efbaf5db483eac0b8f766452757b" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 45483 } } }
I20260811 01:05:18.853703 18324 sys_catalog.cc:458] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9 [sys.catalog]: This master's current role is: LEADER
W20260811 01:05:18.854120 18360 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:05:18.854172 18360 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:05:18.857558 18327 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:05:18.858496 18327 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:05:18.866096 18327 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 049652db32934563b819b5edc9c575c9: Generated new TSK 0
I20260811 01:05:18.866457 18327 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:05:18.897773 18144 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:18.896239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54480 (local address 127.13.30.189:37403)
0811 01:05:18.896281 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.896283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.897015 (+ 732us) server_negotiation.cc:407] Connection header received
0811 01:05:18.897123 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.897124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.897136 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.897165 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.897694 (+ 529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54480: BlockingRecv error: recv got EOF from 127.0.0.1:54480 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 01:05:18.898591 17995 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:18.896003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52908 (local address 127.13.30.190:38899)
0811 01:05:18.896055 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.896057 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.898016 (+ 1959us) server_negotiation.cc:407] Connection header received
0811 01:05:18.898112 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.898113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.898124 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.898153 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.898523 (+ 370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52908: BlockingRecv error: recv got EOF from 127.0.0.1:52908 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 01:05:18.899459 18264 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:18.896657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59492 (local address 127.13.30.188:45483)
0811 01:05:18.896698 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.896700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.898858 (+ 2158us) server_negotiation.cc:407] Connection header received
0811 01:05:18.899017 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.899018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.899030 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.899057 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.899392 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59492: BlockingRecv error: recv got EOF from 127.0.0.1:59492 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 01:05:18.902076 18144 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:18.901216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54488 (local address 127.13.30.189:37403)
0811 01:05:18.901257 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.901259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.901514 (+ 255us) server_negotiation.cc:407] Connection header received
0811 01:05:18.901625 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.901626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.901648 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.901675 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.902023 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54488: BlockingRecv error: recv got EOF from 127.0.0.1:54488 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 01:05:18.906330 18144 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:18.905465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54492 (local address 127.13.30.189:37403)
0811 01:05:18.905505 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.905507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.905780 (+ 273us) server_negotiation.cc:407] Connection header received
0811 01:05:18.905893 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.905894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.905906 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.905934 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.906275 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54492: BlockingRecv error: recv got EOF from 127.0.0.1:54492 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 01:05:18.910688 18144 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:18.909759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54494 (local address 127.13.30.189:37403)
0811 01:05:18.909798 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.909799 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.910076 (+ 277us) server_negotiation.cc:407] Connection header received
0811 01:05:18.910176 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.910177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.910188 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.910217 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.910628 (+ 411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54494: BlockingRecv error: recv got EOF from 127.0.0.1:54494 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 01:05:18.917022 18144 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:18.916131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54500 (local address 127.13.30.189:37403)
0811 01:05:18.916178 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.916179 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.916431 (+ 252us) server_negotiation.cc:407] Connection header received
0811 01:05:18.916532 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.916532 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.916544 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.916571 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.916957 (+ 386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54500: BlockingRecv error: recv got EOF from 127.0.0.1:54500 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 01:05:18.927515 18144 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:18.926548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54506 (local address 127.13.30.189:37403)
0811 01:05:18.926597 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.926599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.926900 (+ 301us) server_negotiation.cc:407] Connection header received
0811 01:05:18.927004 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.927006 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.927018 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.927047 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.927451 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54506: BlockingRecv error: recv got EOF from 127.0.0.1:54506 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 01:05:18.946376 18144 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:18.945217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54512 (local address 127.13.30.189:37403)
0811 01:05:18.945265 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.945267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.945617 (+ 350us) server_negotiation.cc:407] Connection header received
0811 01:05:18.945725 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.945727 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.945739 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.945770 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.946310 (+ 540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54512: BlockingRecv error: recv got EOF from 127.0.0.1:54512 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 01:05:18.981040 18144 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:18.979987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54516 (local address 127.13.30.189:37403)
0811 01:05:18.980041 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:18.980043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:18.980358 (+ 315us) server_negotiation.cc:407] Connection header received
0811 01:05:18.980465 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:18.980466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:18.980479 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:18.980510 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:18.980970 (+ 460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54516: BlockingRecv error: recv got EOF from 127.0.0.1:54516 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 01:05:19.047269 18144 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:19.046554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54522 (local address 127.13.30.189:37403)
0811 01:05:19.046628 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:19.046630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:19.046780 (+ 150us) server_negotiation.cc:407] Connection header received
0811 01:05:19.046819 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:19.046820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:19.046834 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:19.046886 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:19.047214 (+ 328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54522: BlockingRecv error: recv got EOF from 127.0.0.1:54522 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 01:05:19.177649 18144 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:19.176643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54534 (local address 127.13.30.189:37403)
0811 01:05:19.176755 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:19.176758 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:19.176849 (+ 91us) server_negotiation.cc:407] Connection header received
0811 01:05:19.176960 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:19.176961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:19.176979 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:19.177033 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:19.177577 (+ 544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54534: BlockingRecv error: recv got EOF from 127.0.0.1:54534 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260811 01:05:19.435422 18144 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:19.434814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54544 (local address 127.13.30.189:37403)
0811 01:05:19.434879 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:19.434880 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:19.434891 (+ 11us) server_negotiation.cc:407] Connection header received
0811 01:05:19.434957 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:19.434958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:19.434971 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:19.435032 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:19.435366 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54544: BlockingRecv error: recv got EOF from 127.0.0.1:54544 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 01:05:19.797183 18314 catalog_manager.cc:1259] Loaded cluster ID: c60244e88570477bade30c1c99808f7f
I20260811 01:05:19.797286 18314 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b: loading cluster ID for follower catalog manager: success
I20260811 01:05:19.798188 18314 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b: acquiring CA information for follower catalog manager: success
I20260811 01:05:19.798532 18314 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5580efbaf5db483eac0b8f766452757b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:05:19.854868 18360 catalog_manager.cc:1259] Loaded cluster ID: c60244e88570477bade30c1c99808f7f
I20260811 01:05:19.854997 18360 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024: loading cluster ID for follower catalog manager: success
I20260811 01:05:19.855996 18360 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024: acquiring CA information for follower catalog manager: success
I20260811 01:05:19.856637 18360 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4f20b25a4f244a22bfa3d60f31c49024: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:05:19.952075 18476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:19.949162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60276 (local address 127.13.30.189:37403)
0811 01:05:19.949502 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:19.949505 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:19.949522 (+ 17us) server_negotiation.cc:407] Connection header received
0811 01:05:19.949638 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:19.949639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:19.949699 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:19.949778 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:05:19.949951 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:19.950479 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:19.951284 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:19.951482 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:19.951538 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:19.951706 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:05:19.951835 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:05:19.951906 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:19.951943 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 01:05:19.951967 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":77,"threads_started":1}
I20260811 01:05:19.957070 18485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:19.954452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59916 (local address 127.13.30.188:45483)
0811 01:05:19.954573 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:19.954575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:19.954584 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:05:19.954625 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:19.954626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:19.954664 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:19.954737 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:05:19.954825 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:19.955316 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:19.956133 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:19.956406 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:19.956477 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:19.956632 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:05:19.956805 (+ 173us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:05:19.956880 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:19.956897 (+ 17us) server_negotiation.cc:299] Negotiation successful
0811 01:05:19.956931 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":66,"threads_started":1}
I20260811 01:05:19.962008 18476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:19.958999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60286 (local address 127.13.30.189:37403)
0811 01:05:19.959114 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:19.959115 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:19.959249 (+ 134us) server_negotiation.cc:407] Connection header received
0811 01:05:19.959407 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:19.959408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:19.959425 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:19.959477 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:05:19.959609 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:19.960135 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:19.961109 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:19.961421 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:19.961505 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:19.961685 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:05:19.961726 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:05:19.961775 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:19.961889 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 01:05:19.961922 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 01:05:19.962234 18485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:19.959342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59918 (local address 127.13.30.188:45483)
0811 01:05:19.959406 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:19.959408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:19.959415 (+ 7us) server_negotiation.cc:407] Connection header received
0811 01:05:19.959440 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:19.959441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:19.959452 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:19.959508 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:05:19.959676 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:19.960453 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:19.961432 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:19.961739 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:19.961796 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:19.961977 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:05:19.962013 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:05:19.962039 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:19.962136 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 01:05:19.962164 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 01:05:19.962469 18496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:19.959008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42494 (local address 127.13.30.190:38899)
0811 01:05:19.959136 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:19.959138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:19.959153 (+ 15us) server_negotiation.cc:407] Connection header received
0811 01:05:19.959279 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:19.959375 (+ 96us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:19.959442 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:19.959524 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:05:19.959701 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:19.960453 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:19.961374 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:19.961668 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:19.961741 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:19.961908 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:05:19.962137 (+ 229us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:05:19.962196 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:19.962347 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 01:05:19.962377 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":59,"threads_started":1}
I20260811 01:05:19.964171 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 17881
I20260811 01:05:19.992035 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 18006
I20260811 01:05:20.006640 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 18146
2026-08-11T01:05:20Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3031 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:05:20 dist-test-slave-42z9 krb5kdc[18502](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:05:20 dist-test-slave-42z9 krb5kdc[18502](info): set up 2 sockets
Aug 11 01:05:20 dist-test-slave-42z9 krb5kdc[18502](info): commencing operation
krb5kdc: starting...
W20260811 01:05:21.217160 13434 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/test-user.keytab.
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:05:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:05:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.30.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
Entry for principal kudu/127.13.30.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab.
I20260811 01:05:21.369801 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:42243
--webserver_interface=127.13.30.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:38487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:42243,127.13.30.189:38261,127.13.30.188:34845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:05:21.461609 18521 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:05:21.461879 18521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:21.461896 18521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:21.461920 18521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:21.463282 18521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:21.463354 18521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:21.463369 18521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:21.463382 18521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:21.463393 18521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:21.465206 18521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:38487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:42243,127.13.30.189:38261,127.13.30.188:34845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.190.keytab
--principal=kudu/127.13.30.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.190:42243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.30.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:21.465564 18521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:21.465813 18521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:21.471038 18537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:21.471043 18531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:21.471038 18534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:21.471597 18521 server_base.cc:1034] running on GCE node
I20260811 01:05:21.472055 18521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:21.472479 18521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:21.473644 18521 hybrid_clock.cc:648] HybridClock initialized: now 1786410321473629 us; error 50 us; skew 500 ppm
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:21.476915 18521 init.cc:377] Logged in from keytab as kudu/127.13.30.190@KRBTEST.COM (short username kudu)
I20260811 01:05:21.477638 18521 webserver.cc:460] Webserver started at http://127.13.30.190:34973/ using document root <none> and password file <none>
I20260811 01:05:21.478012 18521 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:21.478075 18521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:21.478237 18521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:21.479458 18521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/data/instance:
uuid: "a91871a87af94057b8da2073a266203f"
format_stamp: "Formatted at 2026-08-11 01:05:21 on dist-test-slave-42z9"
server_key: "093930ac84938ada7d13b38b596cd7f7"
server_key_iv: "b34e8faf13e90d19d69557e1ab4659a1"
server_key_version: "encryptionkey@0"
I20260811 01:05:21.479839 18521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/wal/instance:
uuid: "a91871a87af94057b8da2073a266203f"
format_stamp: "Formatted at 2026-08-11 01:05:21 on dist-test-slave-42z9"
server_key: "093930ac84938ada7d13b38b596cd7f7"
server_key_iv: "b34e8faf13e90d19d69557e1ab4659a1"
server_key_version: "encryptionkey@0"
I20260811 01:05:21.481257 18521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 01:05:21.482254 18545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:21.482481 18521 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:21.482585 18521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/wal
uuid: "a91871a87af94057b8da2073a266203f"
format_stamp: "Formatted at 2026-08-11 01:05:21 on dist-test-slave-42z9"
server_key: "093930ac84938ada7d13b38b596cd7f7"
server_key_iv: "b34e8faf13e90d19d69557e1ab4659a1"
server_key_version: "encryptionkey@0"
I20260811 01:05:21.482653 18521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:21.494830 18521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:21.497125 18521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:21.497255 18521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:21.501669 18521 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.190:42243
I20260811 01:05:21.501755 18644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.190:42243 every 8 connection(s)
I20260811 01:05:21.502134 18521 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/data/info.pb
I20260811 01:05:21.503316 18645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:21.505012 18645 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:05:21.507112 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 18521
I20260811 01:05:21.507210 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-0/wal/instance
I20260811 01:05:21.507383 13434 external_mini_cluster.cc:1428] Setting key 23131a86aeb9a0f0573999a17346fddd
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.30.189@KRBTEST.COM; defaulting to no policy
I20260811 01:05:21.517993 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.505858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50692 (local address 127.13.30.190:42243)
0811 01:05:21.506048 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.506058 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.506180 (+ 122us) server_negotiation.cc:407] Connection header received
0811 01:05:21.506765 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.506767 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.506785 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.506864 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.507542 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.508757 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.510588 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.510961 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.511070 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.513830 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.513839 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.513840 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.513848 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.515767 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.516256 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.516259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.516259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.516345 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.516675 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.516677 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.516678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.517056 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.517186 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.517580 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.517793 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":103,"server-negotiator.queue_time_us":151,"thread_start_us":87,"threads_started":1}
I20260811 01:05:21.518008 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.505819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42243 (local address 127.0.0.1:50692)
0811 01:05:21.506037 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.506080 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:21.506607 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:21.506875 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:21.506878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:21.507207 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:21.507416 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.507421 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.508950 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.508952 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.510426 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.510441 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.511086 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.511088 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.511174 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.511781 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:21.511792 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:21.513710 (+ 1918us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:21.515880 (+ 2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.515889 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.515891 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.516169 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.516410 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.516410 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.516411 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.516542 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.517190 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:21.517199 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:21.517320 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 01:05:21.517495 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 01:05:21.517716 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":4,"thread_start_us":109,"threads_started":1}
I20260811 01:05:21.519105 18645 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:05:21.519657 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.519391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:38261 (local address 127.0.0.1:37150)
0811 01:05:21.519534 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.519616 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
W20260811 01:05:21.519901 18546 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.30.189:38261: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.189@KRBTEST.COM" created.
I20260811 01:05:21.520488 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.520296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:38261 (local address 127.0.0.1:37152)
0811 01:05:21.520402 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.520452 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260811 01:05:21.520604 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.189:38261: Network error: Client connection negotiation failed: client connection to 127.13.30.189:38261: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.189.keytab.
Entry for principal kudu/127.13.30.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.189.keytab.
I20260811 01:05:21.537793 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.189:38261
--webserver_interface=127.13.30.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.189.keytab
--principal=kudu/127.13.30.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:38487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:42243,127.13.30.189:38261,127.13.30.188:34845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:05:21.569900 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } attempt: 1
I20260811 01:05:21.570698 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.570473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:38261 (local address 127.0.0.1:37162)
0811 01:05:21.570576 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.570651 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 01:05:21.571115 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.571017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:38261 (local address 127.0.0.1:37172)
0811 01:05:21.571065 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.571095 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 01:05:21.571244 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.189:38261: Network error: Client connection negotiation failed: client connection to 127.13.30.189:38261: connect: Connection refused (error 111)
W20260811 01:05:21.631202 18655 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:05:21.631443 18655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:21.631464 18655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:21.631484 18655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:21.632650 18655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:21.632697 18655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:21.632711 18655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:21.632722 18655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:21.632733 18655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:21.634413 18655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:38487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:42243,127.13.30.189:38261,127.13.30.188:34845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.189.keytab
--principal=kudu/127.13.30.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.189:38261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.30.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:21.634706 18655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:21.634953 18655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:05:21.639444 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } attempt: 2
I20260811 01:05:21.639981 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.639842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:38261 (local address 127.0.0.1:37188)
0811 01:05:21.639913 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.639942 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 01:05:21.640499 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.640358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:38261 (local address 127.0.0.1:37190)
0811 01:05:21.640423 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.640452 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.189:38261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 01:05:21.640494 18660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:21.640484 18665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:21.640606 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.189:38261: Network error: Client connection negotiation failed: client connection to 127.13.30.189:38261: connect: Connection refused (error 111)
W20260811 01:05:21.640486 18662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:21.640784 18655 server_base.cc:1034] running on GCE node
I20260811 01:05:21.641037 18655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:21.641343 18655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:21.642544 18655 hybrid_clock.cc:648] HybridClock initialized: now 1786410321642509 us; error 50 us; skew 500 ppm
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:21.645479 18655 init.cc:377] Logged in from keytab as kudu/127.13.30.189@KRBTEST.COM (short username kudu)
I20260811 01:05:21.646061 18655 webserver.cc:460] Webserver started at http://127.13.30.189:34743/ using document root <none> and password file <none>
I20260811 01:05:21.646302 18655 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:21.646355 18655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:21.646498 18655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:21.647663 18655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/data/instance:
uuid: "115e3cb19e3b4c0e828dc92e1917c90c"
format_stamp: "Formatted at 2026-08-11 01:05:21 on dist-test-slave-42z9"
server_key: "cf0d99c4068021ccd5a88c91143259e8"
server_key_iv: "3e0bea6bb1a6e6ac51c28e2fa4155e05"
server_key_version: "encryptionkey@0"
I20260811 01:05:21.648036 18655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/wal/instance:
uuid: "115e3cb19e3b4c0e828dc92e1917c90c"
format_stamp: "Formatted at 2026-08-11 01:05:21 on dist-test-slave-42z9"
server_key: "cf0d99c4068021ccd5a88c91143259e8"
server_key_iv: "3e0bea6bb1a6e6ac51c28e2fa4155e05"
server_key_version: "encryptionkey@0"
I20260811 01:05:21.649664 18655 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 01:05:21.650947 18678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:21.651207 18655 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:21.651326 18655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/wal
uuid: "115e3cb19e3b4c0e828dc92e1917c90c"
format_stamp: "Formatted at 2026-08-11 01:05:21 on dist-test-slave-42z9"
server_key: "cf0d99c4068021ccd5a88c91143259e8"
server_key_iv: "3e0bea6bb1a6e6ac51c28e2fa4155e05"
server_key_version: "encryptionkey@0"
I20260811 01:05:21.651424 18655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:21.661619 18655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:21.663985 18655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:21.664147 18655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:21.668377 18655 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.189:38261
I20260811 01:05:21.668434 18773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.189:38261 every 8 connection(s)
I20260811 01:05:21.668799 18655 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/data/info.pb
I20260811 01:05:21.669948 18774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:21.671620 18774 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:05:21.676002 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 18655
I20260811 01:05:21.676110 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-1/wal/instance
I20260811 01:05:21.676304 13434 external_mini_cluster.cc:1428] Setting key e527b3ee2caa0be6ff82a6bb3e1873c2
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.189@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:05:21.682502 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.672426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50706 (local address 127.13.30.190:42243)
0811 01:05:21.672485 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.672487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.672688 (+ 201us) server_negotiation.cc:407] Connection header received
0811 01:05:21.673313 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.673316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.673342 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.673498 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.674260 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.674802 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.675902 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.676117 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.676181 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.678735 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.678737 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.678737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.678750 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.680463 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.681246 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.681248 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.681248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.681335 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.681664 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.681665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.681665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.681842 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.681909 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.682246 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.682379 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 01:05:21.682777 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.672366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42243 (local address 127.0.0.1:50706)
0811 01:05:21.672568 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.672613 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:21.673106 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:21.673571 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:21.673575 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:21.673871 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:21.674107 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.674113 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.674930 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.674931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.675776 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.675778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.676243 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.676244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.676378 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.676945 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:21.676955 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:21.678608 (+ 1653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:21.680629 (+ 2021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.680648 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.680652 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.681097 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.681407 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.681408 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.681408 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.681598 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.681910 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:21.681919 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:21.682106 (+ 187us) client_negotiation.cc:769] Sending connection context
0811 01:05:21.682240 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 01:05:21.682485 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":95,"threads_started":1}
I20260811 01:05:21.683692 18774 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.13.30.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.30.188@KRBTEST.COM" created.
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.189@KRBTEST.COM for kudu/127.13.30.189@KRBTEST.COM
I20260811 01:05:21.692278 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.684088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:38261 (local address 127.0.0.1:37196)
0811 01:05:21.684168 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.684177 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:21.684221 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:21.684505 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:21.684506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:21.684676 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:21.684759 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.684762 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.685719 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.685720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.686247 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.686249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.687003 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.687005 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.687089 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.687666 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:21.687671 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:21.689113 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:21.691165 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.691167 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.691167 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.691352 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.691575 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.691576 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.691576 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.691625 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.691895 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:21.691897 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:21.691939 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 01:05:21.692003 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 01:05:21.692132 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 01:05:21.692313 18785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.684164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37196 (local address 127.13.30.189:38261)
0811 01:05:21.684370 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.684375 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.684395 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:05:21.684413 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.684414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.684426 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.684490 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.684827 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.685628 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.686329 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.686884 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.686961 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.689203 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.689215 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.689215 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.689223 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.691028 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.691443 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.691446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.691447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.691514 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.691661 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.691661 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.691661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.691833 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.691910 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.692044 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.692198 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":82,"server-negotiator.queue_time_us":176,"thread_start_us":124,"threads_started":1}
I20260811 01:05:21.692941 18774 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:05:21.693372 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.693222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:34845 (local address 127.0.0.1:44240)
0811 01:05:21.693277 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.693340 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 01:05:21.693542 18686 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
I20260811 01:05:21.694013 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.693908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:34845 (local address 127.0.0.1:44254)
0811 01:05:21.693955 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.693988 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 01:05:21.694118 18774 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:34845: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.30.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.188.keytab.
Entry for principal kudu/127.13.30.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.188.keytab.
I20260811 01:05:21.705284 13434 external_mini_cluster.cc:1326] Running /tmp/dist-test-task0Qaj6g/build/release/bin/kudu
/tmp/dist-test-task0Qaj6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.188:34845
--webserver_interface=127.13.30.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.188.keytab
--principal=kudu/127.13.30.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.30.148:38487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.30.190:42243,127.13.30.189:38261,127.13.30.188:34845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:05:21.731783 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } attempt: 3
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for kudu/127.13.30.189@KRBTEST.COM
I20260811 01:05:21.741603 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.732249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:38261 (local address 127.0.0.1:37212)
0811 01:05:21.732379 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.732399 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:21.732513 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:21.732954 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:21.732955 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:21.733126 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:21.733210 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.733213 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.734261 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.734262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.734821 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.734822 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.735327 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.735328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.735404 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.736113 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:21.736120 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:21.737937 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:21.740080 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.740083 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.740083 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.740369 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.740705 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.740706 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.740706 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.740782 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.741175 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:21.741178 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:21.741257 (+ 79us) client_negotiation.cc:769] Sending connection context
0811 01:05:21.741343 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 01:05:21.741507 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 01:05:21.741616 18785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.732482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37212 (local address 127.13.30.189:38261)
0811 01:05:21.732579 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.732581 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.732631 (+ 50us) server_negotiation.cc:407] Connection header received
0811 01:05:21.732670 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.732672 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.732686 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.732941 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.733350 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.734145 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.734904 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.735231 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.735304 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.738057 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.738059 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.738059 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.738069 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.739907 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.740476 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.740477 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.740477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.740567 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.740857 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.740858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.740858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.741013 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.741088 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.741380 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.741519 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 01:05:21.742199 18645 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:05:21.742576 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.742472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:34845 (local address 127.0.0.1:44268)
0811 01:05:21.742518 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.742551 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 01:05:21.742902 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.742830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:34845 (local address 127.0.0.1:44274)
0811 01:05:21.742865 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.742888 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 01:05:21.742982 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:34845: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
I20260811 01:05:21.743333 18774 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } attempt: 1
I20260811 01:05:21.743700 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.743581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:34845 (local address 127.0.0.1:44286)
0811 01:05:21.743640 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.743674 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 01:05:21.744025 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.743938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:34845 (local address 127.0.0.1:44296)
0811 01:05:21.743975 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.744001 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 01:05:21.744122 18774 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:34845: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
I20260811 01:05:21.774183 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } attempt: 1
I20260811 01:05:21.774983 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.774807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:34845 (local address 127.0.0.1:44310)
0811 01:05:21.774888 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.774932 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 01:05:21.775364 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.775279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:34845 (local address 127.0.0.1:44320)
0811 01:05:21.775319 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.775345 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 01:05:21.775460 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:34845: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
W20260811 01:05:21.800756 18788 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:05:21.801025 18788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:05:21.801052 18788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:05:21.801083 18788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:05:21.802413 18788 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:05:21.802484 18788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:05:21.802507 18788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:05:21.802527 18788 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:05:21.802546 18788 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:05:21.804332 18788 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.30.148:38487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.30.190:42243,127.13.30.189:38261,127.13.30.188:34845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/krb5kdc/kudu_127.13.30.188.keytab
--principal=kudu/127.13.30.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.30.188:34845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.30.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 01:05:21.804647 18788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:05:21.804893 18788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:05:21.810108 18798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:05:21.810096 18799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:21.810132 18788 server_base.cc:1034] running on GCE node
W20260811 01:05:21.810087 18801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:05:21.810545 18788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:05:21.810868 18788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:05:21.812062 18788 hybrid_clock.cc:648] HybridClock initialized: now 1786410321812039 us; error 31 us; skew 500 ppm
I20260811 01:05:21.812350 18774 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } attempt: 2
I20260811 01:05:21.813030 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.812821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:34845 (local address 127.0.0.1:44334)
0811 01:05:21.812906 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.812964 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 01:05:21.813527 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.813388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:34845 (local address 127.0.0.1:44350)
0811 01:05:21.813468 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.813503 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 01:05:21.813657 18774 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.30.188:34845: Network error: Client connection negotiation failed: client connection to 127.13.30.188:34845: connect: Connection refused (error 111)
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:05:21.815464 18788 init.cc:377] Logged in from keytab as kudu/127.13.30.188@KRBTEST.COM (short username kudu)
I20260811 01:05:21.815953 18788 webserver.cc:460] Webserver started at http://127.13.30.188:42639/ using document root <none> and password file <none>
I20260811 01:05:21.816147 18788 fs_manager.cc:359] Metadata directory not provided
I20260811 01:05:21.816187 18788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:05:21.816289 18788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:05:21.817391 18788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/data/instance:
uuid: "a8eb2229b7e24366b3d6b81345307ea6"
format_stamp: "Formatted at 2026-08-11 01:05:21 on dist-test-slave-42z9"
server_key: "f02ad9b833bcbc59488f4fcdb42a07cc"
server_key_iv: "72d72b11c38f11d4bba7c1f31395b684"
server_key_version: "encryptionkey@0"
I20260811 01:05:21.817782 18788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/wal/instance:
uuid: "a8eb2229b7e24366b3d6b81345307ea6"
format_stamp: "Formatted at 2026-08-11 01:05:21 on dist-test-slave-42z9"
server_key: "f02ad9b833bcbc59488f4fcdb42a07cc"
server_key_iv: "72d72b11c38f11d4bba7c1f31395b684"
server_key_version: "encryptionkey@0"
I20260811 01:05:21.819170 18788 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:21.820040 18811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:05:21.820212 18788 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:05:21.820304 18788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/data,/tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/wal
uuid: "a8eb2229b7e24366b3d6b81345307ea6"
format_stamp: "Formatted at 2026-08-11 01:05:21 on dist-test-slave-42z9"
server_key: "f02ad9b833bcbc59488f4fcdb42a07cc"
server_key_iv: "72d72b11c38f11d4bba7c1f31395b684"
server_key_version: "encryptionkey@0"
I20260811 01:05:21.820370 18788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:05:21.841846 18788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:05:21.843969 18788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:05:21.844099 18788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:05:21.848384 18788 rpc_server.cc:307] RPC server started. Bound to: 127.13.30.188:34845
I20260811 01:05:21.848430 18891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.30.188:34845 every 8 connection(s)
I20260811 01:05:21.848809 18788 server_base.cc:1166] Dumped server information to /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/data/info.pb
I20260811 01:05:21.849982 18893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:05:21.850623 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } attempt: 2
I20260811 01:05:21.852085 18893 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:05:21.853582 13434 external_mini_cluster.cc:1388] Started /tmp/dist-test-task0Qaj6g/build/release/bin/kudu as pid 18788
I20260811 01:05:21.853688 13434 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task0Qaj6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786410030080353-13434-0/minicluster-data/master-2/wal/instance
I20260811 01:05:21.853960 13434 external_mini_cluster.cc:1428] Setting key da00f3921996967362a565e79e002de6
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.190@KRBTEST.COM for kudu/127.13.30.188@KRBTEST.COM
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.188@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.188@KRBTEST.COM
I20260811 01:05:21.860977 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.852823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50720 (local address 127.13.30.190:42243)
0811 01:05:21.852884 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.852886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.853049 (+ 163us) server_negotiation.cc:407] Connection header received
0811 01:05:21.853110 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.853111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.853120 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.853166 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.853844 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.854493 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.855448 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.855661 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.855713 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.858257 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.858258 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.858259 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.858266 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.859529 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.859957 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.859958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.859959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.860024 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.860294 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.860295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.860295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.860480 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.860546 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.860776 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.860875 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 01:05:21.861195 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.850968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:34845 (local address 127.0.0.1:44356)
0811 01:05:21.851040 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.851055 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:21.851123 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:21.852197 (+ 1074us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:21.852198 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:21.852360 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:21.852415 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.852417 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.854078 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.854079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.854831 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.854834 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.855649 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.855650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.855702 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.856178 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:21.856182 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:21.857646 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:21.859773 (+ 2127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.859774 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.859775 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.859967 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.860181 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.860182 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.860182 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.860240 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.860685 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:21.860686 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:21.860732 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 01:05:21.860794 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 01:05:21.861123 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":242}
I20260811 01:05:21.861232 18896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.852773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.190:42243 (local address 127.0.0.1:50720)
0811 01:05:21.852932 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.852974 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:21.853058 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:21.853202 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:21.853204 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:21.853608 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:21.853742 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.853749 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.854573 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.854574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.855363 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.855366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.855803 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.855805 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.855877 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.856375 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:21.856385 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:21.858179 (+ 1794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:21.859605 (+ 1426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.859612 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.859615 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.859868 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.860104 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.860105 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.860106 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.860224 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.860573 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:21.860581 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:21.860660 (+ 79us) client_negotiation.cc:769] Sending connection context
0811 01:05:21.860760 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 01:05:21.860958 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
I20260811 01:05:21.861235 18895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.851162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44356 (local address 127.13.30.188:34845)
0811 01:05:21.851353 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.851364 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.851399 (+ 35us) server_negotiation.cc:407] Connection header received
0811 01:05:21.851939 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.851949 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.852015 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.852182 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.852552 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.853985 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.854911 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.855556 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.855726 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.857731 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.857741 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.857741 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.857748 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.859662 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.860028 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.860031 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.860032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.860124 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.860309 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.860310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.860310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.860606 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.860701 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.860895 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.861031 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":137,"thread_start_us":79,"threads_started":1}
I20260811 01:05:21.862002 18893 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:05:21.863124 18645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f: Bootstrap starting.
I20260811 01:05:21.864152 18645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:21.864424 18900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.854640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44360 (local address 127.13.30.188:34845)
0811 01:05:21.854812 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.854814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.854823 (+ 9us) server_negotiation.cc:407] Connection header received
0811 01:05:21.854843 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.854844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.854854 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.855775 (+ 921us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.855824 (+ 49us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.856478 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.857198 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.857426 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.857509 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.860145 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.860146 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.860146 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.860152 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.863053 (+ 2901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.863431 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.863432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.863432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.863500 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.863682 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.863682 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.863683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.863844 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.864008 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.864091 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.864170 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":151,"thread_start_us":110,"threads_started":1}
I20260811 01:05:21.864455 18645 log.cc:824] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:21.865389 18645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f: No bootstrap required, opened a new log
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.188@KRBTEST.COM for kudu/127.13.30.189@KRBTEST.COM
I20260811 01:05:21.867597 18645 raft_consensus.cc:348] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } }
I20260811 01:05:21.867743 18645 raft_consensus.cc:729] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91871a87af94057b8da2073a266203f, State: Initialized, Role: FOLLOWER
I20260811 01:05:21.867834 18645 consensus_queue.cc:260] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } }
I20260811 01:05:21.868165 18905 sys_catalog.cc:455] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } } }
I20260811 01:05:21.868237 18645 sys_catalog.cc:564] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:21.868379 18905 sys_catalog.cc:458] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [sys.catalog]: This master's current role is: FOLLOWER
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.190@KRBTEST.COM
I20260811 01:05:21.870198 18785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.862361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37214 (local address 127.13.30.189:38261)
0811 01:05:21.862412 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.862413 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.862515 (+ 102us) server_negotiation.cc:407] Connection header received
0811 01:05:21.862571 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.862572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.862585 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.862638 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.862904 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.863586 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.864815 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.865113 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.865191 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.867274 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.867276 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.867277 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.867286 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.868848 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.869285 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.869286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.869287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.869349 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.869590 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.869591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.869591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.869740 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.869788 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.870018 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.870105 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 01:05:21.870517 18896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.862291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.189:38261 (local address 127.0.0.1:37214)
0811 01:05:21.862445 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.862456 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:21.862509 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:21.862651 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:21.862651 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:21.862783 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:21.862829 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.862831 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.863671 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.863672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.864722 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.864725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.865193 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.865194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.865262 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.865713 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:21.865719 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:21.867178 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:21.868956 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.868957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.868958 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.869190 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.869419 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.869420 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.869420 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.869509 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.869840 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:21.869841 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:21.869891 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 01:05:21.870289 (+ 398us) client_negotiation.cc:240] Negotiation successful
0811 01:05:21.870419 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":1}
W20260811 01:05:21.870615 18925 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:05:21.870741 18925 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:05:21.871240 18893 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:05:21.874445 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.865067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50728 (local address 127.13.30.190:42243)
0811 01:05:21.865226 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.865227 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.865235 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:05:21.865253 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.865254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.865263 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.865309 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.865904 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.866360 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.867074 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.867287 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.867345 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.870816 (+ 3471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.870818 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.870818 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.870826 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.872874 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.873290 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.873291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.873291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.873347 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.873590 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.873592 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.873592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.873732 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.873854 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.874271 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.874345 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
I20260811 01:05:21.871426 18521 master_runner.cc:186] Error getting master registration for 127.13.30.189:38261: OK, instance_id { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" instance_seqno: 1786410321667157 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:05:21.875149 18521 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.188@KRBTEST.COM for kudu/127.13.30.188@KRBTEST.COM
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.30.189@KRBTEST.COM
I20260811 01:05:21.882408 18896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.871525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:34845 (local address 127.0.0.1:44362)
0811 01:05:21.873551 (+ 2026us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.873565 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:21.873622 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:21.873780 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:21.873781 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:21.873951 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:21.874007 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.874009 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.875110 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.875111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.875904 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.875907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.876398 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.876399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.876459 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.876969 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:21.876974 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:21.879625 (+ 2651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:21.881370 (+ 1745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.881371 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.881371 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.881607 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.881781 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.881781 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.881782 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.881835 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.882097 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:21.882098 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:21.882139 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 01:05:21.882194 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 01:05:21.882288 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1989}
I20260811 01:05:21.882665 18900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.871581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44362 (local address 127.13.30.188:34845)
0811 01:05:21.871621 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.871622 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.873674 (+ 2052us) server_negotiation.cc:407] Connection header received
0811 01:05:21.873694 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.873694 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.873703 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.873740 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.874082 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.875026 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.875994 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.876315 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.876385 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.879738 (+ 3353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.879740 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.879740 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.879748 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.881277 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.881671 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.881672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.881672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.881727 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.881892 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.881893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.881893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.882042 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.882098 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.882541 (+ 443us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.882617 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 01:05:21.883538 18785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.875094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37218 (local address 127.13.30.189:38261)
0811 01:05:21.875135 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.875137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.875261 (+ 124us) server_negotiation.cc:407] Connection header received
0811 01:05:21.875284 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.875285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.875295 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.875342 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.875819 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.876588 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.877432 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.877738 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.877812 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.880399 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.880401 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.880401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.880408 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.882114 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.882705 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.882707 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.882707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.882773 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.882986 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.882987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.882987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.883103 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.883246 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.883290 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.883369 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 01:05:21.884228 18893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6: Bootstrap starting.
I20260811 01:05:21.884670 13434 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:05:21.885004 18893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:21.885301 18893 log.cc:824] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:21.885532 18594 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "a91871a87af94057b8da2073a266203f"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50728
I20260811 01:05:21.885679 18594 raft_consensus.cc:482] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 01:05:21.885737 18594 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:21.886245 18893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6: No bootstrap required, opened a new log
I20260811 01:05:21.886694 18594 raft_consensus.cc:504] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } }
I20260811 01:05:21.886958 18594 leader_election.cc:288] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [CANDIDATE]: Term 1 election: Requested vote from peers 115e3cb19e3b4c0e828dc92e1917c90c (127.13.30.189:38261), a8eb2229b7e24366b3d6b81345307ea6 (127.13.30.188:34845)
I20260811 01:05:21.887966 18893 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } }
I20260811 01:05:21.888089 18893 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8eb2229b7e24366b3d6b81345307ea6, State: Initialized, Role: FOLLOWER
I20260811 01:05:21.888144 18893 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } }
I20260811 01:05:21.888412 18893 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:21.888441 18933 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } } }
I20260811 01:05:21.888607 18933 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:05:21.890129 18850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a91871a87af94057b8da2073a266203f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a8eb2229b7e24366b3d6b81345307ea6"
I20260811 01:05:21.890249 18850 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:21.891157 18850 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91871a87af94057b8da2073a266203f in term 1.
I20260811 01:05:21.891480 18548 leader_election.cc:302] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8eb2229b7e24366b3d6b81345307ea6, a91871a87af94057b8da2073a266203f; no voters:
I20260811 01:05:21.891625 18905 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:05:21.891772 18905 raft_consensus.cc:686] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [term 1 LEADER]: Becoming Leader. State: Replica: a91871a87af94057b8da2073a266203f, State: Running, Role: LEADER
I20260811 01:05:21.891860 18905 consensus_queue.cc:237] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } }
W20260811 01:05:21.891916 18945 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:05:21.891964 18945 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:05:21.892269 18905 sys_catalog.cc:455] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a91871a87af94057b8da2073a266203f. Latest consensus state: current_term: 1 leader_uuid: "a91871a87af94057b8da2073a266203f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } } }
I20260811 01:05:21.892351 18905 sys_catalog.cc:458] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:21.893952 18960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:05:21.894491 18960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:05:21.892650 18788 master_runner.cc:186] Error getting master registration for 127.13.30.189:38261: OK, instance_id { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" instance_seqno: 1786410321667157 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:05:21.894995 18788 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:05:21.897239 18850 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6 [term 1 FOLLOWER]: Refusing update from remote peer a91871a87af94057b8da2073a266203f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:05:21.897636 18905 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:05:21.900395 18933 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a91871a87af94057b8da2073a266203f. Latest consensus state: current_term: 1 leader_uuid: "a91871a87af94057b8da2073a266203f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } } }
I20260811 01:05:21.900550 18933 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:05:21.901965 18785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.892322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37222 (local address 127.13.30.189:38261)
0811 01:05:21.892475 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.892478 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.892942 (+ 464us) server_negotiation.cc:407] Connection header received
0811 01:05:21.893061 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.893062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.893074 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.893127 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.894089 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.894845 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.895918 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.896252 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.896294 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.897953 (+ 1659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.897954 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.897955 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.897962 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.899797 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.901008 (+ 1211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.901010 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.901010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.901080 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.901281 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.901282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.901282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.901467 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.901548 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.901770 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.901867 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260811 01:05:21.904779 18774 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } attempt: 3
Aug 11 01:05:21 dist-test-slave-42z9 krb5kdc[18502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786410321, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.30.189@KRBTEST.COM for kudu/127.13.30.188@KRBTEST.COM
I20260811 01:05:21.910259 18900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.892489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44378 (local address 127.13.30.188:34845)
0811 01:05:21.892535 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.892537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.902577 (+ 10040us) server_negotiation.cc:407] Connection header received
0811 01:05:21.902676 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.902677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.902688 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.902716 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.903456 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.904196 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.905226 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.905579 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.905623 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.907174 (+ 1551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.907176 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.907176 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.907184 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.908900 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.909314 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.909315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.909316 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.909377 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.909608 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.909608 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.909609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.909744 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.909831 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.910063 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.910147 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 01:05:21.912894 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.905106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.30.188:34845 (local address 127.0.0.1:44382)
0811 01:05:21.905158 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 01:05:21.905167 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 01:05:21.905203 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:05:21.905332 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:05:21.905347 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:05:21.905554 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:05:21.905602 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.905604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.906445 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.906446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.907216 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:05:21.907218 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.907730 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.907731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:05:21.907794 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.908157 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:05:21.908161 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:05:21.909662 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:05:21.911536 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.911537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.911538 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.911752 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.911939 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:05:21.911940 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:05:21.911941 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:05:21.912001 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:05:21.912549 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:05:21.912550 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:05:21.912600 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 01:05:21.912662 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 01:05:21.912771 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 01:05:21.913389 18970 mvcc.cc:205] Tried to move back new op lower bound from 7317136678486949888 to 7317136678469713920. Current Snapshot: MvccSnapshot[applied={T|T < 7317136678486949888}]
I20260811 01:05:21.914079 18933 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a91871a87af94057b8da2073a266203f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } } }
I20260811 01:05:21.914193 18933 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:05:21.914572 18955 sys_catalog.cc:455] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a91871a87af94057b8da2073a266203f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } } }
I20260811 01:05:21.914683 18955 sys_catalog.cc:458] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:21.915042 18895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.905153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44382 (local address 127.13.30.188:34845)
0811 01:05:21.905192 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.905194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.905201 (+ 7us) server_negotiation.cc:407] Connection header received
0811 01:05:21.905268 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.905269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.905279 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.905324 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.905672 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.906362 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.907291 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.907610 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.907672 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.909756 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.909758 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.909758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.909766 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.911465 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.911822 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.911823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.911823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.911879 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.912047 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.912048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.912048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.912482 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.912546 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.914861 (+ 2315us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.914954 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 01:05:21.915148 18971 mvcc.cc:205] Tried to move back new op lower bound from 7317136678486949888 to 7317136678469713920. Current Snapshot: MvccSnapshot[applied={T|T < 7317136678486949888}]
I20260811 01:05:21.916460 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:21.892643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50732 (local address 127.13.30.190:42243)
0811 01:05:21.892684 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.892686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.901618 (+ 8932us) server_negotiation.cc:407] Connection header received
0811 01:05:21.909539 (+ 7921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.909542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.909559 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.909594 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.910256 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.910919 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.911572 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:21.911823 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:21.911886 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:21.913316 (+ 1430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:05:21.913318 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:05:21.913318 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:05:21.913326 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:05:21.914946 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.915607 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.915608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.915609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.915672 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:05:21.915864 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:05:21.915865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:05:21.915866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:05:21.915995 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:05:21.916067 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:21.916275 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 01:05:21.916372 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 01:05:21.917255 18774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c: Bootstrap starting.
I20260811 01:05:21.918093 18774 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c: Neither blocks nor log segments found. Creating new log.
I20260811 01:05:21.918409 18774 log.cc:824] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:05:21.919312 18774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c: No bootstrap required, opened a new log
I20260811 01:05:21.921383 18774 raft_consensus.cc:348] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } }
I20260811 01:05:21.921787 18774 raft_consensus.cc:729] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 115e3cb19e3b4c0e828dc92e1917c90c, State: Initialized, Role: FOLLOWER
I20260811 01:05:21.921924 18774 consensus_queue.cc:260] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } }
I20260811 01:05:21.922385 18774 sys_catalog.cc:564] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:05:21.922456 18729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a91871a87af94057b8da2073a266203f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "115e3cb19e3b4c0e828dc92e1917c90c"
I20260811 01:05:21.922367 18983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } } }
I20260811 01:05:21.923935 18983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:05:21.922500 18727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:05:21.923974 18960 catalog_manager.cc:1347] Generated new cluster ID: 7d2b2ce4e98f4d3cb31243676f115d15
I20260811 01:05:21.924019 18960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:05:21.924934 18727 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c [term 1 FOLLOWER]: Refusing update from remote peer a91871a87af94057b8da2073a266203f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:05:21.925287 18955 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [LEADER]: Connected to new peer: Peer: permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:05:21.926084 18729 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a91871a87af94057b8da2073a266203f in term 1.
I20260811 01:05:21.928805 18983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a91871a87af94057b8da2073a266203f. Latest consensus state: current_term: 1 leader_uuid: "a91871a87af94057b8da2073a266203f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } } }
I20260811 01:05:21.928890 18983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:05:21.928917 18983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a91871a87af94057b8da2073a266203f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } } }
I20260811 01:05:21.928946 18983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c [sys.catalog]: This master's current role is: FOLLOWER
W20260811 01:05:21.929528 19003 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:05:21.929579 19003 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:05:21.934058 19004 mvcc.cc:205] Tried to move back new op lower bound from 7317136678486949888 to 7317136678469713920. Current Snapshot: MvccSnapshot[applied={T|T < 7317136678486949888}]
I20260811 01:05:21.939496 18955 sys_catalog.cc:455] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a91871a87af94057b8da2073a266203f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a91871a87af94057b8da2073a266203f" member_type: VOTER last_known_addr { host: "127.13.30.190" port: 42243 } } peers { permanent_uuid: "115e3cb19e3b4c0e828dc92e1917c90c" member_type: VOTER last_known_addr { host: "127.13.30.189" port: 38261 } } peers { permanent_uuid: "a8eb2229b7e24366b3d6b81345307ea6" member_type: VOTER last_known_addr { host: "127.13.30.188" port: 34845 } } }
I20260811 01:05:21.939622 18955 sys_catalog.cc:458] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f [sys.catalog]: This master's current role is: LEADER
I20260811 01:05:21.941890 18960 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:05:21.942663 18960 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:05:21.955940 18960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a91871a87af94057b8da2073a266203f: Generated new TSK 0
I20260811 01:05:21.956199 18960 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:05:21.986927 18651 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:21.985201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50738 (local address 127.13.30.190:42243)
0811 01:05:21.985241 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.985243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.986114 (+ 871us) server_negotiation.cc:407] Connection header received
0811 01:05:21.986221 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.986223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.986235 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.986283 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.986829 (+ 546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50738: BlockingRecv error: recv got EOF from 127.0.0.1:50738 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 01:05:21.987742 18895 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:21.985407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44384 (local address 127.13.30.188:34845)
0811 01:05:21.985501 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.985503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.987210 (+ 1707us) server_negotiation.cc:407] Connection header received
0811 01:05:21.987307 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.987308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.987320 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.987349 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.987678 (+ 329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44384: BlockingRecv error: recv got EOF from 127.0.0.1:44384 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 01:05:21.988502 18785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:21.984920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37234 (local address 127.13.30.189:38261)
0811 01:05:21.985010 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.985012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.987993 (+ 2981us) server_negotiation.cc:407] Connection header received
0811 01:05:21.988091 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.988092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.988104 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.988132 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.988436 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37234: BlockingRecv error: recv got EOF from 127.0.0.1:37234 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 01:05:21.991088 18785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:21.990153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37246 (local address 127.13.30.189:38261)
0811 01:05:21.990189 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.990191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.990448 (+ 257us) server_negotiation.cc:407] Connection header received
0811 01:05:21.990626 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.990627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.990649 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.990677 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.991036 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37246: BlockingRecv error: recv got EOF from 127.0.0.1:37246 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 01:05:21.994387 18785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:21.993624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37256 (local address 127.13.30.189:38261)
0811 01:05:21.993670 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.993672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.993842 (+ 170us) server_negotiation.cc:407] Connection header received
0811 01:05:21.993933 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.993935 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.993946 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.993985 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.994325 (+ 340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37256: BlockingRecv error: recv got EOF from 127.0.0.1:37256 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 01:05:21.998677 18785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:21.997780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37268 (local address 127.13.30.189:38261)
0811 01:05:21.997822 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:21.997823 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:21.998094 (+ 271us) server_negotiation.cc:407] Connection header received
0811 01:05:21.998196 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:21.998197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:21.998209 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:21.998237 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:21.998615 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37268: BlockingRecv error: recv got EOF from 127.0.0.1:37268 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 01:05:22.005183 18785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:22.004098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37272 (local address 127.13.30.189:38261)
0811 01:05:22.004149 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:22.004150 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:22.004514 (+ 364us) server_negotiation.cc:407] Connection header received
0811 01:05:22.004627 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:22.004628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:22.004641 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:22.004673 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:22.005116 (+ 443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37272: BlockingRecv error: recv got EOF from 127.0.0.1:37272 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 01:05:22.015889 18785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:22.014867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37288 (local address 127.13.30.189:38261)
0811 01:05:22.014914 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:22.014916 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:22.015228 (+ 312us) server_negotiation.cc:407] Connection header received
0811 01:05:22.015338 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:22.015340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:22.015354 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:22.015383 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:22.015822 (+ 439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37288: BlockingRecv error: recv got EOF from 127.0.0.1:37288 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 01:05:22.034736 18785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:22.033651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37304 (local address 127.13.30.189:38261)
0811 01:05:22.033701 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:22.033703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:22.034000 (+ 297us) server_negotiation.cc:407] Connection header received
0811 01:05:22.034116 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:22.034117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:22.034131 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:22.034163 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:22.034669 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37304: BlockingRecv error: recv got EOF from 127.0.0.1:37304 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 01:05:22.069288 18785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:22.068309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37314 (local address 127.13.30.189:38261)
0811 01:05:22.068374 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:22.068376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:22.068673 (+ 297us) server_negotiation.cc:407] Connection header received
0811 01:05:22.068775 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:22.068776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:22.068788 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:22.068818 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:22.069217 (+ 399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37314: BlockingRecv error: recv got EOF from 127.0.0.1:37314 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260811 01:05:22.135649 18785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:22.134967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37320 (local address 127.13.30.189:38261)
0811 01:05:22.135069 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:22.135071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:22.135084 (+ 13us) server_negotiation.cc:407] Connection header received
0811 01:05:22.135157 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:22.135159 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:22.135172 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:22.135216 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:22.135583 (+ 367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37320: BlockingRecv error: recv got EOF from 127.0.0.1:37320 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 01:05:22.265669 18785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:22.264959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37330 (local address 127.13.30.189:38261)
0811 01:05:22.265048 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:22.265050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:22.265079 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:05:22.265167 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:22.265168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:22.265180 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:22.265230 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:22.265604 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37330: BlockingRecv error: recv got EOF from 127.0.0.1:37330 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 01:05:22.523962 18785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:05:22.523193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37346 (local address 127.13.30.189:38261)
0811 01:05:22.523254 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:22.523256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:22.523346 (+ 90us) server_negotiation.cc:407] Connection header received
0811 01:05:22.523437 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:22.523438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:22.523449 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:22.523493 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:05:22.523886 (+ 393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37346: BlockingRecv error: recv got EOF from 127.0.0.1:37346 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 01:05:22.892491 18945 catalog_manager.cc:1259] Loaded cluster ID: 7d2b2ce4e98f4d3cb31243676f115d15
I20260811 01:05:22.892592 18945 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6: loading cluster ID for follower catalog manager: success
I20260811 01:05:22.893419 18945 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6: acquiring CA information for follower catalog manager: success
I20260811 01:05:22.893790 18945 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a8eb2229b7e24366b3d6b81345307ea6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:05:22.930115 19003 catalog_manager.cc:1259] Loaded cluster ID: 7d2b2ce4e98f4d3cb31243676f115d15
I20260811 01:05:22.930207 19003 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c: loading cluster ID for follower catalog manager: success
I20260811 01:05:22.930977 19003 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c: acquiring CA information for follower catalog manager: success
I20260811 01:05:22.931262 19003 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 115e3cb19e3b4c0e828dc92e1917c90c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:05:23.040339 19129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:23.037373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37350 (local address 127.13.30.189:38261)
0811 01:05:23.037553 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:23.037556 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:23.037633 (+ 77us) server_negotiation.cc:407] Connection header received
0811 01:05:23.037695 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:23.037696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:23.037835 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:23.037950 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:05:23.038264 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:23.038798 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:23.039604 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:23.039793 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:23.039841 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:23.040022 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:05:23.040139 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:05:23.040196 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:23.040227 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 01:05:23.040246 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":112,"threads_started":1}
I20260811 01:05:23.044710 19143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:23.042253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44398 (local address 127.13.30.188:34845)
0811 01:05:23.042366 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:23.042368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:23.042376 (+ 8us) server_negotiation.cc:407] Connection header received
0811 01:05:23.042415 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:23.042416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:23.042456 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:23.042534 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:05:23.042622 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:23.043137 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:23.044012 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:23.044215 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:23.044279 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:23.044376 (+ 97us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:05:23.044496 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:05:23.044550 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:23.044590 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 01:05:23.044609 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":57,"threads_started":1}
I20260811 01:05:23.049386 19143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:23.046429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44412 (local address 127.13.30.188:34845)
0811 01:05:23.046472 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:23.046474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:23.046842 (+ 368us) server_negotiation.cc:407] Connection header received
0811 01:05:23.046942 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:23.046943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:23.046956 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:23.047003 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:05:23.047097 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:23.047562 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:23.048635 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:23.048885 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:23.048921 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:23.049126 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:05:23.049160 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:05:23.049185 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:23.049283 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 01:05:23.049304 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 01:05:23.049399 19129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:23.046549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37362 (local address 127.13.30.189:38261)
0811 01:05:23.046614 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:23.046616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:23.046678 (+ 62us) server_negotiation.cc:407] Connection header received
0811 01:05:23.046748 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:23.046749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:23.046759 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:23.046804 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:05:23.046970 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:23.047708 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:23.048696 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:23.048967 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:23.049037 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:23.049127 (+ 90us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:05:23.049158 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:05:23.049209 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:23.049302 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 01:05:23.049325 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 01:05:23.049568 19158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:05:23.046445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50742 (local address 127.13.30.190:42243)
0811 01:05:23.046582 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 01:05:23.046584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 01:05:23.046596 (+ 12us) server_negotiation.cc:407] Connection header received
0811 01:05:23.046650 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:05:23.046651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:05:23.046712 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:05:23.046796 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:05:23.046908 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:23.047717 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:23.048547 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:05:23.048789 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:05:23.048852 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:05:23.049032 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:05:23.049149 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:05:23.049214 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 01:05:23.049260 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 01:05:23.049288 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":56,"threads_started":1}
I20260811 01:05:23.051225 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 18521
I20260811 01:05:23.066461 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 18655
I20260811 01:05:23.081729 13434 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task0Qaj6g/build/release/bin/kudu with pid 18788
2026-08-11T01:05:23Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3080 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6111 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (293003 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST